-- Logs begin at Mon 2022-08-29 18:13:37 UTC, end at Mon 2022-08-29 19:29:28 UTC. -- Aug 29 18:52:48.564471 dv-cinder-850830-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 18:52:48.573543 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 18:52:48.575452 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 18:52:48 2022] *** Aug 29 18:52:48.575452 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 18:52:48.575452 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 18:52:48.575452 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: nodename: dv-cinder-850830-2-iscsi Aug 29 18:52:48.575452 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: machine: x86_64 Aug 29 18:52:48.575452 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: clock source: unix Aug 29 18:52:48.575452 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: pcre jit disabled Aug 29 18:52:48.575452 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: detected number of CPU cores: 4 Aug 29 18:52:48.575452 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: current working directory: / Aug 29 18:52:48.575452 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: detected binary path: /usr/bin/uwsgi-core Aug 29 18:52:48.576719 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: your processes number limit is 47680 Aug 29 18:52:48.576719 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: your memory page size is 4096 bytes Aug 29 18:52:48.576719 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: detected max file descriptor number: 2048 Aug 29 18:52:48.576719 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: lock engine: pthread robust mutexes Aug 29 18:52:48.576719 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: thunder lock: enabled Aug 29 18:52:48.576719 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 18:52:48.576719 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 18:52:48.614548 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: Python main interpreter initialized at 0x558b8c7189c0 Aug 29 18:52:48.614548 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: python threads support enabled Aug 29 18:52:48.614548 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: your server socket listen backlog is limited to 100 connections Aug 29 18:52:48.614548 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: your mercy for graceful operations on workers is 90 seconds Aug 29 18:52:48.614884 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 18:52:48.614966 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: *** Operational MODE: preforking *** Aug 29 18:52:48.615254 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: *** uWSGI is running in multiple interpreter mode *** Aug 29 18:52:48.615254 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: spawned uWSGI master process (pid: 105475) Aug 29 18:52:48.615435 dv-cinder-850830-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 18:52:48.623054 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: spawned uWSGI worker 1 (pid: 105476, cores: 1) Aug 29 18:52:48.623054 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: spawned uWSGI worker 2 (pid: 105477, cores: 1) Aug 29 18:52:48.623054 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 18:52:49.275243 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 18:52:49.283492 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 18:52:50.372920 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 18:52:50.372920 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: from cryptography.utils import int_from_bytes Aug 29 18:52:50.373536 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 18:52:50.373536 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: from cryptography.utils import int_from_bytes Aug 29 18:52:50.376638 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 18:52:50.376638 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: from cryptography.utils import int_from_bytes Aug 29 18:52:50.377055 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 18:52:50.377055 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: from cryptography.utils import int_from_bytes Aug 29 18:52:52.905940 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 18:52:52.906498 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 18:52:52.906714 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 18:52:52.907098 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 18:52:52.907357 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 18:52:52.907750 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.908082 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.908403 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.908722 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.909051 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.909362 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.909707 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.910049 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.910375 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.910635 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.910949 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.911300 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850830-2-iscsi {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.911622 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.911930 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.912086 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 18:52:52.912457 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.912538 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 18:52:52.912621 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.912836 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.912921 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 18:52:52.913155 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.913258 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 18:52:52.913450 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 18:52:52.913545 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.913839 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.913925 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.914168 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.914365 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.914476 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.914672 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.914794 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.914981 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.915124 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.915369 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.915516 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.915687 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.915812 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.915999 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.916130 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.916320 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.916452 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.916629 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.916745 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.916941 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.917071 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.917248 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.917371 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850830-2-iscsi {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.917575 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.917705 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850830-2-iscsi {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.917883 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.918015 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.918194 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.918357 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.918513 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.918638 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.918818 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.918964 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.919164 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.919290 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.919470 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.919601 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.919903 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.920034 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.920228 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.920352 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.920536 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.920672 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.920858 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.920980 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.921176 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.921298 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.921496 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.921698 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.921833 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.921976 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.922098 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.922226 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.922395 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.922519 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.922703 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.922827 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.923035 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.923162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.923409 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.923546 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850830-2-iscsi {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.923712 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.923863 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.923962 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.924178 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.924266 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.924492 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.924588 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.924869 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.924955 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.925189 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.925284 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.925444 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.925547 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.925692 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.925802 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.926009 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.926124 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.926346 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.926448 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.926639 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.926758 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.926940 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.927108 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.927273 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.927429 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.927578 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.927750 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.927890 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.928055 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.928195 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.928362 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.928501 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.928672 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.928809 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.928991 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.929128 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.929294 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.929441 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.929598 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.929762 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.929858 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.930068 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.930155 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.930388 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.930540 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.930781 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.930879 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.931566 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.931699 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.931877 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.931974 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.932197 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.932347 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.932518 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.932654 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.932824 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.932954 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.933137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.933269 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.933447 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.933571 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.933754 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.933885 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.934059 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.934184 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.934458 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.934581 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.934702 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.934833 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.934955 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.935109 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.935271 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.935396 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.935545 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.935677 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.935848 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.935973 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.936151 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.936276 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.936467 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.936608 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.936774 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.936912 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.937079 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.937223 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.937384 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.937511 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.937684 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.937808 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.938052 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.938197 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.938330 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.938476 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.938598 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.938717 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.938883 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.939028 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.939222 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.939354 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.939523 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.939655 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.939827 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.939958 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.940130 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.940268 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.940432 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.940564 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.940750 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.940874 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.941069 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.941194 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.941359 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.941481 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.941662 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.941793 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.941964 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.942089 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.942266 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.942399 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.942573 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.942704 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.942876 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.943026 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.943204 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.943336 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.943506 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.943640 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.943811 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.943934 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.944112 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.944237 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.944416 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.944552 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.944721 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.944846 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.945024 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.945146 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.945326 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.945464 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.945628 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.945750 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.945929 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.946051 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.946235 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.946369 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.946558 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.947215 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.947480 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.947853 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.948054 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.948178 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.948298 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.948454 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.948586 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.948763 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.948897 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.949071 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.949203 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.949394 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.949519 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.949704 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.949836 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.950012 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.950137 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.950330 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.950452 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.950636 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.950770 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.950937 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.951078 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.951268 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.951393 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.951584 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.951721 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.951892 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.952024 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.952210 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.952334 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.952510 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.952644 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.952815 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.952940 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.953132 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.953264 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.953437 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.953563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.953742 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.953867 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.954046 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.954170 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.954350 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.954483 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.954653 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.954778 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.954957 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.955113 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.955283 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.955408 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.955587 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.955718 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.955887 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.956019 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.956207 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.956333 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.956530 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.956661 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.956839 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.956972 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.957144 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.957268 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.957447 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.957577 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.957767 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:52:52.957900 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.958105 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.958240 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.958439 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.958588 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.958761 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.958897 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.959096 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.959227 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.959432 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.959585 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.959766 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.959899 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.960079 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.960202 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.960397 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.960522 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.960712 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.960845 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.961023 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.961146 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.961335 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.961466 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.961645 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.961769 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.961959 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.962085 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.962305 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.962430 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.962616 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.962747 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.962938 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.963139 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.963380 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.963508 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.963638 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.963761 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.963887 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.964009 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.964178 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.964301 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.964490 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.964622 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.964801 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.964933 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.965113 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.965245 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.965450 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.965575 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.965766 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.965897 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.966089 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.966223 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.966405 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.966536 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.966716 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.966852 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.967055 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.967196 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.967371 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.967501 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.967685 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.967816 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.968003 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.968142 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.968311 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.968440 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.968617 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.968735 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.968922 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.969055 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.969231 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.969356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.969537 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.969660 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.969855 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.969987 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.970170 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.970302 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.970475 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.970599 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.970784 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.970917 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.971144 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.971271 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.971460 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.971585 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.971773 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.971899 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.972085 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.972210 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.972390 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.972515 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.972701 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.972827 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.973011 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.973145 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.973315 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.973443 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.973629 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.973752 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.973937 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.974060 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.974241 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.974374 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.974547 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.974670 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.974853 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.974984 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.975183 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.975323 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.975496 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.975622 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.975803 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.975935 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.976113 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.976248 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.976426 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.976559 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.976734 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.976864 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.977054 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.977185 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.977359 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.977482 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.977669 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.977793 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.978037 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.978163 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.978370 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.978494 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.978674 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.978798 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.979084 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.979210 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.979378 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.979502 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.979683 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.979806 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.979994 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.980118 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.980304 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.980429 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.980608 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.980772 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.980896 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.981015 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.981201 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.981341 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.981496 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.981627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.981802 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.981927 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.982110 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.982245 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.982416 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.982549 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.982722 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.982847 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.983048 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.983188 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.983376 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.983508 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.983683 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.983805 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.983989 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.984114 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.984293 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.984419 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.984599 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.984731 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.984934 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.985057 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.985239 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.985363 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.985574 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.985703 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.985892 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.986023 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.986199 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.986332 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.986510 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.986642 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.986816 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.986940 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.987144 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.987273 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.987450 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.987575 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.987762 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.987894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.988067 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.988192 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.988374 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.988506 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.988682 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.988814 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.988988 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.989121 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.989292 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.989417 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.989603 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.989738 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.989910 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.990032 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.990222 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.990347 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.990526 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.990667 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.990833 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.990957 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.991187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.991312 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.991495 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.991631 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.991838 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.991963 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.992156 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.992287 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.992481 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.992607 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.992794 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.992926 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.993105 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.993228 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.993936 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.994071 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.994257 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.994393 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.994633 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.994767 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.994898 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.995073 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.995198 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.995319 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.995499 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.995628 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.995818 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.995944 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.996130 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.996262 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.996455 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.996589 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.996766 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.996892 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.997085 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.997210 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.997392 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.997530 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.997709 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.997834 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.998028 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.998152 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.998366 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.998498 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.998680 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.998805 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.999010 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.999137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.999335 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.999536 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.999667 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.999789 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:52.999945 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.000070 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.000256 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.000387 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.000560 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.000765 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.000891 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.001011 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.001162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.001288 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.001478 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.001611 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.001789 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.001913 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.002099 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.002225 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.002405 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.002529 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.002719 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.002843 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.003047 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.003177 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.003358 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.003483 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.003663 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.003796 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.003976 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.004093 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.004302 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.004425 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.004613 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.004746 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.004932 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.005055 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.005246 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.005371 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.005549 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.005681 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.005852 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.005977 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.006162 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.006286 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.006472 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.006604 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.006780 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.006901 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.007091 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.007218 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.007399 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.007536 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.007713 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.007837 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.008025 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.008159 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.008336 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.008461 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.008642 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.008774 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.008956 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.009124 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.009824 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.009948 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.010226 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.010358 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.010464 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.010565 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.010736 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.010862 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.011080 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.011209 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.011398 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.011522 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.011706 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.011832 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.012018 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.012142 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.012329 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.012462 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.012638 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.012762 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.012948 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.013072 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.013270 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.013408 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.013578 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.013704 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.013888 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.014014 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.014198 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.014330 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.014501 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.014625 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.014808 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.014934 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.015151 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.015288 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.015470 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.015719 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.015845 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.016051 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.016184 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.016364 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.016488 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.016682 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.016806 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.016990 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.017121 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.017315 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.017449 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.017633 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.017772 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.017944 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.018061 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.018258 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.018384 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.018565 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.018690 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.018875 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.019077 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.019217 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.019339 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.019496 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.019628 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.019807 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.019944 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.020112 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.020238 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.020417 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.020542 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.020721 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.020853 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.021027 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.021151 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.021329 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.021460 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.021634 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.021899 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.022025 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.022228 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.022352 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.022539 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.022664 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.022843 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.022970 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.023179 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.023305 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.023483 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.023607 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.023807 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.024012 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.024137 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.024258 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.024409 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.024545 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.024736 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.024872 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.025044 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.025169 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.025389 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.025520 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.025694 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.025936 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.026062 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.026190 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.026350 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.026482 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.026680 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.026805 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.026987 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.027160 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.027317 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.027443 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.027623 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.027754 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.027932 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.028059 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.028238 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.028363 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.028546 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.028672 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.028856 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.028981 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.029160 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.029292 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.029462 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.029586 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.029766 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.029889 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.030075 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.030208 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.030386 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.030512 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.030697 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.030820 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.031016 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.031154 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.031341 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.031464 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.031621 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.031746 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.031939 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.032073 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.032248 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.032373 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.032553 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.032677 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.032857 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.032991 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.033167 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.033292 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.033477 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.033601 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.033782 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.033908 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.034093 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.034225 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.034395 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.034521 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.034698 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.034829 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.035028 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.035154 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.035327 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.035453 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.035629 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.035753 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.035936 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.036060 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.036243 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.036373 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.036544 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.036668 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.036850 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.036973 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.037156 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.037288 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.037460 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.037591 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.037763 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.037884 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.038083 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.038223 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.038385 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.038521 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.038684 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.038815 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.038986 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.039145 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.039318 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.039444 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.039629 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.039762 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.039931 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.040064 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.040239 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.040883 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.041066 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.041192 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.041436 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.041572 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.041696 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.041824 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.041946 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.042067 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.042249 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.042375 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.042554 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.042680 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.042856 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.042982 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.043184 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.043312 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.043487 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.043612 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.043812 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.043938 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.044120 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.044252 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.044425 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.044544 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.044729 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.044865 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.045033 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.045157 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.045341 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.045464 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.045653 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.045790 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.045979 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.046104 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.046299 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.046431 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.046605 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.046739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.046917 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.047059 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.047249 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.047373 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.047556 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.047694 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.047861 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.047985 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.048164 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.048294 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.048466 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.048590 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.048773 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.048896 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.049079 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.049212 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.049382 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.049506 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.049683 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.049806 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.050004 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.050128 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.050310 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.050434 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.050617 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.050748 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.050923 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.051086 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.051290 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.051425 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.051586 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.051709 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.051890 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.052026 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.052198 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.052321 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.052510 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.052635 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.052820 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.053020 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.053144 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.053267 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.053427 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.053552 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.053738 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.053871 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.054051 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.054175 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.054354 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.054477 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.054664 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.054796 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.054972 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.055115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.055300 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.055425 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.055602 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.055743 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.055927 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.056558 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.056746 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.056870 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.057104 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.057242 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.057373 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.057518 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.057669 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.057844 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.057983 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.058171 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.058295 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.058498 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.058616 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.058807 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.058948 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.059129 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.059315 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.059452 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.059634 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.059758 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.059949 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.060075 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.060258 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.060390 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.060572 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.060710 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.060884 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.061016 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.061201 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.061326 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.061517 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.061652 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.061823 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.061948 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.062131 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.062255 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.062477 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.062611 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.062742 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.062873 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.063055 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.063193 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.063385 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.063519 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.063698 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.063822 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.064005 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.064129 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.064316 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.064442 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.064623 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.064740 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.064934 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.065059 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.065237 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.065360 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.065560 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.065684 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.065869 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.066041 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.066174 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.066296 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.066547 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.066670 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.066858 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.066983 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.067196 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.067322 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.067514 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.067639 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.067831 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.067965 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.068140 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.068264 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.068513 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.068627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.068840 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.068974 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.069158 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.069281 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.069466 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.069589 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.069769 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.069905 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.070073 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.070197 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.070384 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.070507 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.070707 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.070838 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.071030 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.071157 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.071347 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.071483 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.071676 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.071885 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.072018 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.072149 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.072278 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.072407 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.072930 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.073063 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.073195 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.073344 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.073603 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.073737 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.073929 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.074055 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.074239 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.074366 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.074562 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.074687 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.074893 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.075048 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.075223 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.075350 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.075531 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.075665 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.075841 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.075973 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.076147 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.076272 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.076454 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.076588 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.076780 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.076913 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.077085 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.077218 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.077396 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.077528 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.077708 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.077848 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.078018 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.078144 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.078322 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.078446 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.078626 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.078759 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.078956 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.079132 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.079289 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.079420 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.079611 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.079748 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.079924 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.080047 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.080247 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.080379 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.080568 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.080694 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.080871 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.080997 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.081195 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.081320 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.081511 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.081641 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.081804 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.081930 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.082108 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.082233 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.082413 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.082539 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.082733 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.082857 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.083070 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.083207 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.083375 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.083500 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.083688 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.083823 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.084002 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.084135 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.084312 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.084444 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.084617 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.084750 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.084924 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.085058 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.085248 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.085374 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.085556 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.085688 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.085884 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.086020 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.086190 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.086315 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.086497 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.086628 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.086809 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.086943 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.087138 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.087280 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.087469 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.087592 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.087776 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.087904 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.088088 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.088213 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.088445 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.088568 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.088699 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.088811 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.088982 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.089108 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.089304 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.089429 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.089609 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.089735 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.089935 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.090089 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.090245 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.090379 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.090550 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.090684 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.090857 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.090984 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.091177 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.091311 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.091516 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.091641 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.091824 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.091949 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.092153 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.092286 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.092463 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.092596 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.092789 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.092914 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.093097 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.093299 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.093423 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.093543 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.093699 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.093833 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.094006 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.094132 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.094323 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.094444 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.094633 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.094732 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.094940 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.095071 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.095271 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.095367 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.095583 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.095673 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.095890 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.095985 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.096203 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.096291 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.096512 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.096730 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.096828 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.097065 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.097160 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.097383 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.097479 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.097700 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.097789 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.098013 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.098109 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.098329 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.098418 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.098638 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.098725 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.098959 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.099097 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.099298 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.099397 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.099629 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.099720 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.099923 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.100012 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.100238 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.100324 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.100558 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.100654 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.100875 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.100971 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.101196 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.101293 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.101509 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.101598 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.101823 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.101909 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.102135 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.102235 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.102450 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.102538 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.103335 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.103512 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.103658 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.103851 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.103968 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.104360 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.104465 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.104675 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.104798 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.104990 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.105078 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.105304 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.105401 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.105616 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.105714 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.105932 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.106019 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.106247 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.106334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.106558 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.106653 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.106867 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.106961 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.107205 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.107301 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.107522 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.107619 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.107849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.107944 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.108185 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.108280 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.108506 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.108593 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.108820 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.108907 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.109138 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.109243 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.109453 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.109554 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.109811 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.109974 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.110130 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.110295 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.110441 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.110634 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.110760 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.110962 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.111103 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.111332 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.111422 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.111650 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.111738 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.111973 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.112077 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.112306 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.112394 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.112615 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.112703 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.112924 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.113029 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.113230 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.113317 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.113541 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.113634 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.113845 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.113946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.114169 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.114276 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.114482 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.114580 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.114879 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.114984 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.115223 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.115309 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.115536 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.115644 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.115852 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.116069 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.116377 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.116465 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.116696 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.116785 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.117030 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.117118 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.117354 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.117441 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.117669 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.117765 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.117977 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.118066 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.118295 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.118382 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.119172 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.119316 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.119595 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.119732 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.119866 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.119956 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.120111 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.120229 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.120419 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.120508 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.120723 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.120811 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.121035 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.121133 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.121348 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.121438 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.121654 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.121743 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.121965 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.122066 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.122274 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.122368 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.122598 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.122816 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.122920 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.123188 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.123281 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.123506 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.123598 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.123816 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.123984 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.124122 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.124226 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.124424 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.124528 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.124732 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.124842 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.125034 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.125123 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.125344 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.125432 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.125648 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.125745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.125957 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.126045 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.126263 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.126351 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.126569 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.126658 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.126873 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.126959 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.127208 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.127297 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.127519 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.127617 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.127826 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.127922 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.128138 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.128225 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.128445 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.128534 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.128760 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.128847 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.129067 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.129161 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.129379 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.129476 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.129686 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.129777 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.129995 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.130093 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.130299 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.130388 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.130604 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.130694 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.130910 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.131197 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.131289 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.131534 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.131623 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.131846 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.131936 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.132156 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.132372 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.132466 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.132535 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.132758 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.132903 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.133059 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.133203 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.133338 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.133479 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.133688 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.133837 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.134002 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.134166 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.134333 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.134472 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.134639 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.134788 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.134934 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.135106 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.135365 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.135536 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.135674 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.135830 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.135968 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.136104 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.136238 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.136373 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.136514 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.136659 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.136794 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.136946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.137088 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.137342 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.137492 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.137637 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.137774 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.137936 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.138073 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.138244 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.138396 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.138588 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.138730 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.138907 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.139068 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.139256 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.139414 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.139573 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.139715 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.139889 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.140031 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.140201 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.140344 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.140510 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.140652 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.140818 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.140969 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.141113 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.141258 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.141426 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.141568 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.141740 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.141880 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.142052 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.142194 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.142356 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.142508 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.142666 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.142824 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.142962 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.143137 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.143297 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.143441 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.143609 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.143759 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.143919 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.144061 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.144231 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.144372 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.144545 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.144696 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.144887 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.145030 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.145203 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.145345 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.145522 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.145665 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.145837 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.145978 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.146154 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.146295 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.146465 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.146608 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.146776 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.146917 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.147107 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.147251 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.147419 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.147562 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.147722 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.147863 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.148033 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.148174 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.148353 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.148495 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.148656 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.148816 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.148953 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.149095 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.149252 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.149402 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.149562 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.149893 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.150034 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.150200 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.150342 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.150503 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.150666 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.151063 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.151210 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.151358 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.151502 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.151645 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.151780 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.151937 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.152082 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.152218 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.152352 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.152486 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.152620 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.152761 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.152980 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.153119 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.153250 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.153339 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.153446 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.153594 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.153750 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.153905 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.154053 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.154213 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.154355 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.154520 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.154658 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.154832 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.154988 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.155179 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.155344 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.155496 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.155662 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.155813 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.155984 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.156126 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.156296 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.156452 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.156619 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.156771 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.156928 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.157071 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.157249 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.157399 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.157536 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.157675 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.157849 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.157999 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.158150 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.158307 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.158450 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.158591 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.158742 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.158883 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.159098 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.159248 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.159390 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.159531 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.159672 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.159812 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.159961 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.160104 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.160255 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.160397 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.160544 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.160696 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.160845 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.160987 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.161135 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.161278 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.161418 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.161567 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.161716 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.161858 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.162022 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.162179 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.162323 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.162485 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.162650 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.162799 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.162961 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.163141 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.163311 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.163478 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.163633 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.163775 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.163916 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.164056 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.164242 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.164401 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.164561 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.164702 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.164850 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.164991 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.165172 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.165835 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.165983 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.166124 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.166272 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.166413 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.166592 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.166756 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.166918 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.167102 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.167247 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.167388 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.167545 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.167696 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.167867 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.168021 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.168193 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.168350 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.168542 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.168691 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.168842 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.168993 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.169177 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.169337 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.169502 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.169651 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.169820 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.169967 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.170131 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.170287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.170429 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.170569 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.170717 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 18:52:53.170870 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.171082 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.171399 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.171715 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.172030 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.172349 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.172668 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.172982 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.173302 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.173620 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.173950 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.174279 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.174594 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.174924 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.175278 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.175627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.175944 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.176291 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.176621 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.176948 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.177255 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.177564 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:52:53.177809 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 18:52:53.325407 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO dbcounter [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] Registered counter for database nova_api Aug 29 18:52:53.332957 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO dbcounter [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] Registered counter for database nova_api Aug 29 18:52:53.345337 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_db.sqlalchemy.engines [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:52:53.352049 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writer thread running {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:52:53.353353 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG oslo_db.sqlalchemy.engines [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:52:53.359898 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writer thread running {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:52:53.409320 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.context [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d74fd249-f6b1-4f68-a608-7346562653bf(cell1) {{(pid=105476) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 18:52:53.413176 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:52:53.413655 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:52:53.415288 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:52:53.416562 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:52:53.417005 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:52:53.417390 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.context [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d74fd249-f6b1-4f68-a608-7346562653bf(cell1) {{(pid=105477) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 18:52:53.418977 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:52:53.420945 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO dbcounter [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] Registered counter for database nova_cell0 Aug 29 18:52:53.421209 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:52:53.421685 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:52:53.423368 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:52:53.424114 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:52:53.424563 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:52:53.424938 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO dbcounter [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] Registered counter for database nova_cell1 Aug 29 18:52:53.426553 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:52:53.428610 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO dbcounter [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] Registered counter for database nova_cell0 Aug 29 18:52:53.432026 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_db.sqlalchemy.engines [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:52:53.432954 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO dbcounter [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] Registered counter for database nova_cell1 Aug 29 18:52:53.433782 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_db.sqlalchemy.engines [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:52:53.439900 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writer thread running {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:52:53.441356 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writer thread running {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:52:53.443784 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG oslo_db.sqlalchemy.engines [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:52:53.444547 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG oslo_db.sqlalchemy.engines [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:52:53.451906 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writer thread running {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:52:53.453378 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writer thread running {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:52:53.584762 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO dbcounter [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] Registered counter for database nova_cell0 Aug 29 18:52:53.593493 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_db.sqlalchemy.engines [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:52:53.597438 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO dbcounter [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] Registered counter for database nova_cell0 Aug 29 18:52:53.598382 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writer thread running {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:52:53.604885 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG oslo_db.sqlalchemy.engines [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:52:53.609511 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writer thread running {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:52:53.937943 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: WARNING keystonemiddleware.auth_token [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 18:52:53.944424 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: WARNING keystonemiddleware.auth_token [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 18:52:53.945184 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: WARNING keystonemiddleware.auth_token [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 18:52:53.952694 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: WARNING keystonemiddleware.auth_token [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 18:52:54.288107 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: WARNING keystonemiddleware.auth_token [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 18:52:54.294628 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: WARNING keystonemiddleware.auth_token [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 18:52:54.295703 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: WARNING keystonemiddleware.auth_token [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 18:52:54.299961 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558b8c7189c0 pid: 105476 (default app) Aug 29 18:52:54.301735 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: WARNING keystonemiddleware.auth_token [None req-a4474d22-77e6-4295-a8dd-1fa96ec6e3ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 18:52:54.302018 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:52:54.303236 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] 10.222.0.86 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001734 Aug 29 18:52:54.303654 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 1/1] 10.222.0.86 () {50 vars in 788 bytes} [Mon Aug 29 18:52:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:52:54.307054 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558b8c7189c0 pid: 105477 (default app) Aug 29 18:54:12.575275 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:54:12.576542 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002014 Aug 29 18:54:12.577181 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 2/2] 10.222.0.86 () {54 vars in 931 bytes} [Mon Aug 29 18:54:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:54:12.589318 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_api:SELECT=3 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:54:12.590774 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_cell1:SELECT=3 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:54:12.591867 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_cell0:SELECT=3 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:54:12.592984 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:54:13.457424 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-887abe24-219d-4185-bb00-1e334ebb39d4 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:54:13.489225 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-887abe24-219d-4185-bb00-1e334ebb39d4 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.904961 Aug 29 18:54:13.489985 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 1/3] 10.222.0.86 () {60 vars in 1292 bytes} [Mon Aug 29 18:54:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 18:54:15.853028 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:54:15.853977 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-0135ac0a-a6bc-41b9-8b3f-d94d77099ed2 None None] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Aug 29 18:54:15.859470 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 3/4] 10.222.0.86 () {54 vars in 931 bytes} [Mon Aug 29 18:54:15 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:54:16.290054 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-8100ac2c-c36b-4da7-8a20-6f56d3599bbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:16.344203 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-8100ac2c-c36b-4da7-8a20-6f56d3599bbf admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.483947 Aug 29 18:54:16.345006 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 2/5] 10.222.0.86 () {64 vars in 1283 bytes} [Mon Aug 29 18:54:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 18:54:16.359392 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_api:SELECT=3 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:54:16.360293 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_cell1:SELECT=3 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:54:16.361309 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_cell0:SELECT=3 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:54:16.362332 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:54:16.568480 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-bbc1120d-a509-4716-ab3e-755ef9d00169 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:16.642253 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-bbc1120d-a509-4716-ab3e-755ef9d00169 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285281 Aug 29 18:54:16.647618 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 4/6] 10.222.0.86 () {64 vars in 1336 bytes} [Mon Aug 29 18:54:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 18:54:19.003658 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-8100ac2c-c36b-4da7-8a20-6f56d3599bbf admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:54:19.004588 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-8100ac2c-c36b-4da7-8a20-6f56d3599bbf admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 29 18:54:19.004984 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 3/7] 10.222.0.86 () {54 vars in 931 bytes} [Mon Aug 29 18:54:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 18:54:19.678303 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-944725a6-1597-4c52-b6b8-13fa0b4ba363 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "name": "ds512M", "swap": 0, "ram": 512, "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:19.723096 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-944725a6-1597-4c52-b6b8-13fa0b4ba363 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.711647 Aug 29 18:54:19.723684 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 5/8] 10.222.0.86 () {64 vars in 1283 bytes} [Mon Aug 29 18:54:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 18:54:19.736611 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-4246445b-21b9-4ba4-b738-ec4bde4b0559 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:19.776455 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-4246445b-21b9-4ba4-b738-ec4bde4b0559 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043684 Aug 29 18:54:19.777393 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 4/9] 10.222.0.86 () {64 vars in 1336 bytes} [Mon Aug 29 18:54:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 18:54:22.141497 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-944725a6-1597-4c52-b6b8-13fa0b4ba363 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:54:22.142402 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-944725a6-1597-4c52-b6b8-13fa0b4ba363 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 29 18:54:22.142800 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 6/10] 10.222.0.86 () {54 vars in 931 bytes} [Mon Aug 29 18:54:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:54:22.489636 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-9d3c4495-796e-4a8f-89a2-63dd449b516b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:22.509868 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-9d3c4495-796e-4a8f-89a2-63dd449b516b admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.360804 Aug 29 18:54:22.510401 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 5/11] 10.222.0.86 () {64 vars in 1283 bytes} [Mon Aug 29 18:54:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 18:54:22.522503 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-6911b325-c685-440d-b942-5c440a2fe667 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:22.546630 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-6911b325-c685-440d-b942-5c440a2fe667 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027947 Aug 29 18:54:22.547493 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 7/12] 10.222.0.86 () {64 vars in 1336 bytes} [Mon Aug 29 18:54:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 18:54:24.934055 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-9d3c4495-796e-4a8f-89a2-63dd449b516b admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:54:24.934987 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-9d3c4495-796e-4a8f-89a2-63dd449b516b admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 29 18:54:24.935415 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 6/13] 10.222.0.86 () {54 vars in 931 bytes} [Mon Aug 29 18:54:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:54:25.400803 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-b672ab96-5246-4a7f-a46f-6a5a061c6027 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "ram": 2048}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:25.421517 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-b672ab96-5246-4a7f-a46f-6a5a061c6027 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.479990 Aug 29 18:54:25.422438 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 8/14] 10.222.0.86 () {64 vars in 1283 bytes} [Mon Aug 29 18:54:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 18:54:25.435358 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-c90182e4-d169-4eb0-89ac-09de6405df26 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:25.461381 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-c90182e4-d169-4eb0-89ac-09de6405df26 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029957 Aug 29 18:54:25.461873 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 7/15] 10.222.0.86 () {64 vars in 1336 bytes} [Mon Aug 29 18:54:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 18:54:27.841890 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-b672ab96-5246-4a7f-a46f-6a5a061c6027 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:54:27.843668 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-b672ab96-5246-4a7f-a46f-6a5a061c6027 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Aug 29 18:54:27.844688 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 9/16] 10.222.0.86 () {54 vars in 931 bytes} [Mon Aug 29 18:54:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:54:28.295639 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-2d69ed7b-c86f-408d-a698-6a18c3951b36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "id": "d4", "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:28.315779 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-2d69ed7b-c86f-408d-a698-6a18c3951b36 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.465109 Aug 29 18:54:28.323861 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 8/17] 10.222.0.86 () {64 vars in 1283 bytes} [Mon Aug 29 18:54:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 18:54:28.329200 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-9d0e36b6-cf48-4c12-b997-e98369bb4a28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:28.355068 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-9d0e36b6-cf48-4c12-b997-e98369bb4a28 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029890 Aug 29 18:54:28.355814 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 10/18] 10.222.0.86 () {64 vars in 1336 bytes} [Mon Aug 29 18:54:28 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 18:54:30.748735 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-2d69ed7b-c86f-408d-a698-6a18c3951b36 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:54:30.749804 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-2d69ed7b-c86f-408d-a698-6a18c3951b36 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Aug 29 18:54:30.750252 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 9/19] 10.222.0.86 () {54 vars in 931 bytes} [Mon Aug 29 18:54:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:54:31.227449 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-9900ebf8-f14c-4abb-94b5-fe43f777ffd7 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:54:31.252607 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-9900ebf8-f14c-4abb-94b5-fe43f777ffd7 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.496117 Aug 29 18:54:31.253312 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 11/20] 10.222.0.86 () {60 vars in 1292 bytes} [Mon Aug 29 18:54:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 18:54:33.694946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-2d69ed7b-c86f-408d-a698-6a18c3951b36 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:54:33.696521 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-2d69ed7b-c86f-408d-a698-6a18c3951b36 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 Aug 29 18:54:33.696913 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 10/21] 10.222.0.86 () {54 vars in 931 bytes} [Mon Aug 29 18:54:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:54:34.109068 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-357943e1-7dca-42e2-892a-5de830826538 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "swap": 0, "name": "m1.tiny"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:34.129528 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-357943e1-7dca-42e2-892a-5de830826538 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.426140 Aug 29 18:54:34.130165 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 12/22] 10.222.0.86 () {64 vars in 1283 bytes} [Mon Aug 29 18:54:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 18:54:34.143692 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-b221db55-5789-4c4e-94e4-0938fb7d53d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:34.175490 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-b221db55-5789-4c4e-94e4-0938fb7d53d1 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036083 Aug 29 18:54:34.176069 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 11/23] 10.222.0.86 () {64 vars in 1333 bytes} [Mon Aug 29 18:54:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 18:54:36.777901 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-357943e1-7dca-42e2-892a-5de830826538 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:54:36.778913 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-357943e1-7dca-42e2-892a-5de830826538 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 29 18:54:36.779353 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 13/24] 10.222.0.86 () {54 vars in 931 bytes} [Mon Aug 29 18:54:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:54:37.178454 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-eefb77f5-7ff3-4a74-bdf8-d893d5e44dc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:37.198627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-eefb77f5-7ff3-4a74-bdf8-d893d5e44dc6 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.413059 Aug 29 18:54:37.199133 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 12/25] 10.222.0.86 () {64 vars in 1283 bytes} [Mon Aug 29 18:54:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 18:54:37.221133 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-175ce182-20d7-4029-a2c5-93bafc740d5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:37.248030 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-175ce182-20d7-4029-a2c5-93bafc740d5d admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040156 Aug 29 18:54:37.248626 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 14/26] 10.222.0.86 () {64 vars in 1333 bytes} [Mon Aug 29 18:54:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 18:54:39.598233 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-eefb77f5-7ff3-4a74-bdf8-d893d5e44dc6 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:54:39.599452 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-eefb77f5-7ff3-4a74-bdf8-d893d5e44dc6 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Aug 29 18:54:39.599853 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 13/27] 10.222.0.86 () {54 vars in 931 bytes} [Mon Aug 29 18:54:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:54:40.035334 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-ef52b614-d3e2-48f0-9871-da9df6731ce5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "id": "3", "swap": 0, "name": "m1.medium"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:40.056232 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-ef52b614-d3e2-48f0-9871-da9df6731ce5 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.449913 Aug 29 18:54:40.057245 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 15/28] 10.222.0.86 () {64 vars in 1283 bytes} [Mon Aug 29 18:54:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 18:54:40.068867 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-00ba5428-a9c3-4837-8fec-74b00de6021f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:40.097325 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-00ba5428-a9c3-4837-8fec-74b00de6021f admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032248 Aug 29 18:54:40.097890 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 14/29] 10.222.0.86 () {64 vars in 1333 bytes} [Mon Aug 29 18:54:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 18:54:42.651477 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-ef52b614-d3e2-48f0-9871-da9df6731ce5 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:54:42.653141 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-ef52b614-d3e2-48f0-9871-da9df6731ce5 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002219 Aug 29 18:54:42.653978 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 16/30] 10.222.0.86 () {54 vars in 931 bytes} [Mon Aug 29 18:54:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:54:43.115276 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-3f1885d3-1041-49c0-b13f-217a86a9a6b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "disk": 80, "vcpus": 4, "id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:43.121735 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:54:43.138966 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-3f1885d3-1041-49c0-b13f-217a86a9a6b5 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.478472 Aug 29 18:54:43.139634 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 15/31] 10.222.0.86 () {64 vars in 1283 bytes} [Mon Aug 29 18:54:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 18:54:43.151850 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-4bdf6d6b-8e2c-46bf-8f19-3afc621f6af8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:43.176854 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-4bdf6d6b-8e2c-46bf-8f19-3afc621f6af8 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028778 Aug 29 18:54:43.178031 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 17/32] 10.222.0.86 () {64 vars in 1333 bytes} [Mon Aug 29 18:54:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 18:54:45.563331 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-3f1885d3-1041-49c0-b13f-217a86a9a6b5 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:54:45.564336 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-3f1885d3-1041-49c0-b13f-217a86a9a6b5 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 29 18:54:45.564732 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 16/33] 10.222.0.86 () {54 vars in 931 bytes} [Mon Aug 29 18:54:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:54:46.020805 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-12867a2b-01ea-473e-85f4-1e7b5df69c8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "swap": 0, "ram": 16384}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:46.041015 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-12867a2b-01ea-473e-85f4-1e7b5df69c8b admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.469083 Aug 29 18:54:46.041895 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 18/34] 10.222.0.86 () {64 vars in 1283 bytes} [Mon Aug 29 18:54:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 18:54:46.053472 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-f0483f32-2e45-4e0b-b74e-d9d2b398c7a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:54:46.080834 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-f0483f32-2e45-4e0b-b74e-d9d2b398c7a8 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030950 Aug 29 18:54:46.081683 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 17/35] 10.222.0.86 () {64 vars in 1333 bytes} [Mon Aug 29 18:54:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 18:55:07.201558 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-12867a2b-01ea-473e-85f4-1e7b5df69c8b admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:07.202573 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-12867a2b-01ea-473e-85f4-1e7b5df69c8b admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 29 18:55:07.202973 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 19/36] 10.222.0.86 () {54 vars in 931 bytes} [Mon Aug 29 18:55:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:55:07.213617 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:55:07.591100 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-e32cd3a3-595a-435e-9a5e-cf7d9542abe0 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:07.610646 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-e32cd3a3-595a-435e-9a5e-cf7d9542abe0 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401483 Aug 29 18:55:07.611200 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 18/37] 10.222.0.86 () {60 vars in 1292 bytes} [Mon Aug 29 18:55:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 18:55:08.662695 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-12867a2b-01ea-473e-85f4-1e7b5df69c8b admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:08.663724 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-12867a2b-01ea-473e-85f4-1e7b5df69c8b admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 29 18:55:08.664161 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 20/38] 10.222.0.86 () {56 vars in 1074 bytes} [Mon Aug 29 18:55:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:55:09.196854 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-2bec5e6a-09f2-47bc-8bcf-bc6ab76fb8df admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:09.202807 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.wsgi [None req-2bec5e6a-09f2-47bc-8bcf-bc6ab76fb8df admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-2bec5e6a-09f2-47bc-8bcf-bc6ab76fb8df admin admin] Request method failure captured: Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Accept: application/json Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Accept-Encoding: gzip, deflate Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Connection: keep-alive Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Content-Length: 0 Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Host: 10.222.0.86 Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Openstack-Api-Version: compute 2.90 Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Openstack-System-Scope: None Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: User-Agent: python-novaclient Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Auth-Token: gAAAAABjDQuMbyjg--oe1YpSUY_di7tsp1EDPPG7-k9hjdQhE-eSwU_inKii1mxgClxUq2TRGGZ68XQWsk8yACyeu5k25k6xDhpe9UC2G6t-k-dNdUouPD9RcsWP7YxUoQHeWLQNMt59S6mdQePBvRq94b7jukj6bpyBIAlpskohrJbGDcEqtXM Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Domain-Id: None Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Domain-Name: None Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Identity-Status: Confirmed Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Is-Admin-Project: True Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Project-Domain-Id: default Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Project-Domain-Name: Default Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Project-Id: 3e9f996197414d24b783bd100f720103 Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Project-Name: admin Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Role: reader,admin,member Aug 29 18:55:09.206115 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Roles: reader,admin,member Aug 29 18:55:09.208613 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/3e9f996197414d24b783bd100f720103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/3e9f996197414d24b783bd100f720103"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/3e9f996197414d24b783bd100f720103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_3e9f996197414d24b783bd100f720103"}]}] Aug 29 18:55:09.208613 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Tenant: admin Aug 29 18:55:09.208613 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Tenant-Id: 3e9f996197414d24b783bd100f720103 Aug 29 18:55:09.208613 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Tenant-Name: admin Aug 29 18:55:09.208613 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-User: admin Aug 29 18:55:09.208613 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-User-Domain-Id: default Aug 29 18:55:09.208613 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-User-Domain-Name: Default Aug 29 18:55:09.208613 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-User-Id: 9c8f433f2f1f4923859810dc0019845c Aug 29 18:55:09.208613 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-User-Name: admin Aug 29 18:55:09.208613 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: method: > Aug 29 18:55:09.208613 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: exception: Flavor 42 could not be found. Aug 29 18:55:09.208613 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: action_args: {'id': '42'} Aug 29 18:55:09.208613 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 18:55:09.208613 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 18:55:09.210971 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Aug 29 18:55:09.213627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-2bec5e6a-09f2-47bc-8bcf-bc6ab76fb8df admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 18:55:09.215944 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-2bec5e6a-09f2-47bc-8bcf-bc6ab76fb8df admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.406002 Aug 29 18:55:09.215944 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 19/39] 10.222.0.86 () {60 vars in 1190 bytes} [Mon Aug 29 18:55:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 18:55:09.222885 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-b4cf5e5b-2fe6-4ca5-8320-c6e46bc272cc admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:09.227820 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:55:09.248405 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-b4cf5e5b-2fe6-4ca5-8320-c6e46bc272cc admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030234 Aug 29 18:55:09.248951 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 21/40] 10.222.0.86 () {60 vars in 1210 bytes} [Mon Aug 29 18:55:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 18:55:09.258657 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-21aaeb28-c651-4bd9-9e19-7be8fc37fea7 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:09.281224 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-21aaeb28-c651-4bd9-9e19-7be8fc37fea7 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026108 Aug 29 18:55:09.281777 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 20/41] 10.222.0.86 () {60 vars in 1210 bytes} [Mon Aug 29 18:55:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 18:55:09.291583 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-5acdd096-2780-418d-8a9b-8b9ceb1c4f57 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:09.297867 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.wsgi [None req-5acdd096-2780-418d-8a9b-8b9ceb1c4f57 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-5acdd096-2780-418d-8a9b-8b9ceb1c4f57 admin admin] Request method failure captured: Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Accept: application/json Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Accept-Encoding: gzip, deflate Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Connection: keep-alive Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Content-Length: 0 Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Host: 10.222.0.86 Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Openstack-Api-Version: compute 2.90 Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Openstack-System-Scope: None Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: User-Agent: python-novaclient Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Auth-Token: gAAAAABjDQuMbyjg--oe1YpSUY_di7tsp1EDPPG7-k9hjdQhE-eSwU_inKii1mxgClxUq2TRGGZ68XQWsk8yACyeu5k25k6xDhpe9UC2G6t-k-dNdUouPD9RcsWP7YxUoQHeWLQNMt59S6mdQePBvRq94b7jukj6bpyBIAlpskohrJbGDcEqtXM Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Domain-Id: None Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Domain-Name: None Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Identity-Status: Confirmed Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Is-Admin-Project: True Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Project-Domain-Id: default Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Project-Domain-Name: Default Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Project-Id: 3e9f996197414d24b783bd100f720103 Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Project-Name: admin Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Role: reader,admin,member Aug 29 18:55:09.301187 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Roles: reader,admin,member Aug 29 18:55:09.302709 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/3e9f996197414d24b783bd100f720103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/3e9f996197414d24b783bd100f720103"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/3e9f996197414d24b783bd100f720103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_3e9f996197414d24b783bd100f720103"}]}] Aug 29 18:55:09.302709 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Tenant: admin Aug 29 18:55:09.302709 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Tenant-Id: 3e9f996197414d24b783bd100f720103 Aug 29 18:55:09.302709 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Tenant-Name: admin Aug 29 18:55:09.302709 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-User: admin Aug 29 18:55:09.302709 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-User-Domain-Id: default Aug 29 18:55:09.302709 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-User-Domain-Name: Default Aug 29 18:55:09.302709 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-User-Id: 9c8f433f2f1f4923859810dc0019845c Aug 29 18:55:09.302709 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-User-Name: admin Aug 29 18:55:09.302709 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: method: > Aug 29 18:55:09.302709 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: exception: Flavor 42 could not be found. Aug 29 18:55:09.302709 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: action_args: {'id': '42'} Aug 29 18:55:09.302709 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 18:55:09.302709 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 18:55:09.303739 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 29 18:55:09.304894 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-5acdd096-2780-418d-8a9b-8b9ceb1c4f57 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 18:55:09.305889 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-5acdd096-2780-418d-8a9b-8b9ceb1c4f57 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015284 Aug 29 18:55:09.305889 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 22/42] 10.222.0.86 () {60 vars in 1190 bytes} [Mon Aug 29 18:55:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 18:55:10.263515 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-21aaeb28-c651-4bd9-9e19-7be8fc37fea7 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:10.264514 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-21aaeb28-c651-4bd9-9e19-7be8fc37fea7 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 29 18:55:10.264905 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 21/43] 10.222.0.86 () {56 vars in 1074 bytes} [Mon Aug 29 18:55:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:55:10.791014 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-15a23945-501f-4587-9b75-e68687ff5b7a admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:10.796259 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.wsgi [None req-15a23945-501f-4587-9b75-e68687ff5b7a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-15a23945-501f-4587-9b75-e68687ff5b7a admin admin] Request method failure captured: Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Accept: application/json Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Accept-Encoding: gzip, deflate Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Connection: keep-alive Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Content-Length: 0 Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Host: 10.222.0.86 Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Openstack-Api-Version: compute 2.90 Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Openstack-System-Scope: None Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: User-Agent: python-novaclient Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Auth-Token: gAAAAABjDQuOSEeyXoz_1XGTyTSzH2WBh4GhMq8QVet_4Jisl5Aj3zSnh8t-cq42YBCy0j9ME98OV_OSawYuHnFOwjOgCJH9VCasJVVafr5l2Wj8n0pBf2wxOI4HswYIkKcz9MOE5W33t99Pqg2dAOyyCRRWUrBLmbPYmpiSFnWJWm5MKanfN_0 Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Domain-Id: None Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Domain-Name: None Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Identity-Status: Confirmed Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Is-Admin-Project: True Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Project-Domain-Id: default Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Project-Domain-Name: Default Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Project-Id: 3e9f996197414d24b783bd100f720103 Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Project-Name: admin Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Role: reader,admin,member Aug 29 18:55:10.797745 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Roles: reader,admin,member Aug 29 18:55:10.799315 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/3e9f996197414d24b783bd100f720103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/3e9f996197414d24b783bd100f720103"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/3e9f996197414d24b783bd100f720103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_3e9f996197414d24b783bd100f720103"}]}] Aug 29 18:55:10.799315 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Tenant: admin Aug 29 18:55:10.799315 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Tenant-Id: 3e9f996197414d24b783bd100f720103 Aug 29 18:55:10.799315 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Tenant-Name: admin Aug 29 18:55:10.799315 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-User: admin Aug 29 18:55:10.799315 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-User-Domain-Id: default Aug 29 18:55:10.799315 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-User-Domain-Name: Default Aug 29 18:55:10.799315 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-User-Id: 9c8f433f2f1f4923859810dc0019845c Aug 29 18:55:10.799315 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-User-Name: admin Aug 29 18:55:10.799315 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: method: > Aug 29 18:55:10.799315 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: exception: Flavor 84 could not be found. Aug 29 18:55:10.799315 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: action_args: {'id': '84'} Aug 29 18:55:10.799315 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 18:55:10.799315 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 18:55:10.800287 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 29 18:55:10.801563 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-15a23945-501f-4587-9b75-e68687ff5b7a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 18:55:10.802808 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-15a23945-501f-4587-9b75-e68687ff5b7a admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.394161 Aug 29 18:55:10.802808 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 23/44] 10.222.0.86 () {60 vars in 1190 bytes} [Mon Aug 29 18:55:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 18:55:10.808698 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-516c2622-28ad-48ac-a2f6-0177676c29a1 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:10.823988 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-516c2622-28ad-48ac-a2f6-0177676c29a1 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018835 Aug 29 18:55:10.824506 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 22/45] 10.222.0.86 () {60 vars in 1210 bytes} [Mon Aug 29 18:55:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 18:55:10.834126 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-ca9d27cb-18e8-475f-be39-7d5db8f07c47 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:10.852121 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-ca9d27cb-18e8-475f-be39-7d5db8f07c47 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021448 Aug 29 18:55:10.852651 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 24/46] 10.222.0.86 () {60 vars in 1210 bytes} [Mon Aug 29 18:55:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 18:55:10.862437 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-31c7f4fb-d954-491f-bc7c-9688b0d6e4cc admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:10.868073 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.wsgi [None req-31c7f4fb-d954-491f-bc7c-9688b0d6e4cc admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-31c7f4fb-d954-491f-bc7c-9688b0d6e4cc admin admin] Request method failure captured: Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Accept: application/json Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Accept-Encoding: gzip, deflate Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Connection: keep-alive Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Content-Length: 0 Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Host: 10.222.0.86 Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Openstack-Api-Version: compute 2.90 Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Openstack-System-Scope: None Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: User-Agent: python-novaclient Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Auth-Token: gAAAAABjDQuOSEeyXoz_1XGTyTSzH2WBh4GhMq8QVet_4Jisl5Aj3zSnh8t-cq42YBCy0j9ME98OV_OSawYuHnFOwjOgCJH9VCasJVVafr5l2Wj8n0pBf2wxOI4HswYIkKcz9MOE5W33t99Pqg2dAOyyCRRWUrBLmbPYmpiSFnWJWm5MKanfN_0 Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Domain-Id: None Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Domain-Name: None Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Identity-Status: Confirmed Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Is-Admin-Project: True Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Project-Domain-Id: default Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Project-Domain-Name: Default Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Project-Id: 3e9f996197414d24b783bd100f720103 Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Project-Name: admin Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Role: reader,admin,member Aug 29 18:55:10.869606 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Roles: reader,admin,member Aug 29 18:55:10.871177 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/3e9f996197414d24b783bd100f720103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/3e9f996197414d24b783bd100f720103"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/3e9f996197414d24b783bd100f720103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_3e9f996197414d24b783bd100f720103"}]}] Aug 29 18:55:10.871177 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Tenant: admin Aug 29 18:55:10.871177 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Tenant-Id: 3e9f996197414d24b783bd100f720103 Aug 29 18:55:10.871177 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Tenant-Name: admin Aug 29 18:55:10.871177 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-User: admin Aug 29 18:55:10.871177 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-User-Domain-Id: default Aug 29 18:55:10.871177 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-User-Domain-Name: Default Aug 29 18:55:10.871177 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-User-Id: 9c8f433f2f1f4923859810dc0019845c Aug 29 18:55:10.871177 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-User-Name: admin Aug 29 18:55:10.871177 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: method: > Aug 29 18:55:10.871177 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: exception: Flavor 84 could not be found. Aug 29 18:55:10.871177 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: action_args: {'id': '84'} Aug 29 18:55:10.871177 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 18:55:10.871177 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 18:55:10.872137 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Aug 29 18:55:10.873459 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-31c7f4fb-d954-491f-bc7c-9688b0d6e4cc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 18:55:10.874744 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-31c7f4fb-d954-491f-bc7c-9688b0d6e4cc admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013247 Aug 29 18:55:10.874744 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 23/47] 10.222.0.86 () {60 vars in 1190 bytes} [Mon Aug 29 18:55:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 18:55:11.855078 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-ca9d27cb-18e8-475f-be39-7d5db8f07c47 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:11.856083 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-ca9d27cb-18e8-475f-be39-7d5db8f07c47 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 29 18:55:11.856473 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 25/48] 10.222.0.86 () {56 vars in 1074 bytes} [Mon Aug 29 18:55:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:55:12.373101 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-9025c87b-11fd-49e6-8e62-cce20863e85b admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:12.378829 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.wsgi [None req-9025c87b-11fd-49e6-8e62-cce20863e85b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-9025c87b-11fd-49e6-8e62-cce20863e85b admin admin] Request method failure captured: Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Accept: application/json Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Accept-Encoding: gzip, deflate Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Connection: keep-alive Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Content-Length: 0 Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Host: 10.222.0.86 Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Openstack-Api-Version: compute 2.90 Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Openstack-System-Scope: None Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: User-Agent: python-novaclient Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Auth-Token: gAAAAABjDQuPYrbNPjL5_WbSerQerMi0PfdZZp1iRq9vzdoxkBfW2TYYsWn5jvSudb25STlTohcK4XKW7IijfA_sXlW1OHsU9cHQkHwGhJXO4i8hNJIwlnFSLxQOTrpUsN44sWMiTgbyJvhOLIws0yuiIQ7OQTo_NrVKR9TtrzRlaoiWr_J1dtc Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Domain-Id: None Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Domain-Name: None Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Identity-Status: Confirmed Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Is-Admin-Project: True Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Project-Domain-Id: default Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Project-Domain-Name: Default Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Project-Id: 3e9f996197414d24b783bd100f720103 Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Project-Name: admin Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Role: reader,admin,member Aug 29 18:55:12.380356 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Roles: reader,admin,member Aug 29 18:55:12.381920 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/3e9f996197414d24b783bd100f720103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/3e9f996197414d24b783bd100f720103"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/3e9f996197414d24b783bd100f720103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_3e9f996197414d24b783bd100f720103"}]}] Aug 29 18:55:12.381920 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Tenant: admin Aug 29 18:55:12.381920 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Tenant-Id: 3e9f996197414d24b783bd100f720103 Aug 29 18:55:12.381920 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-Tenant-Name: admin Aug 29 18:55:12.381920 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-User: admin Aug 29 18:55:12.381920 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-User-Domain-Id: default Aug 29 18:55:12.381920 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-User-Domain-Name: Default Aug 29 18:55:12.381920 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-User-Id: 9c8f433f2f1f4923859810dc0019845c Aug 29 18:55:12.381920 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: X-User-Name: admin Aug 29 18:55:12.381920 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: method: > Aug 29 18:55:12.381920 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: exception: Flavor 451 could not be found. Aug 29 18:55:12.381920 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: action_args: {'id': '451'} Aug 29 18:55:12.381920 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 18:55:12.381920 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 18:55:12.382946 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Aug 29 18:55:12.384334 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-9025c87b-11fd-49e6-8e62-cce20863e85b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 18:55:12.385554 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-9025c87b-11fd-49e6-8e62-cce20863e85b admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.386738 Aug 29 18:55:12.385554 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 24/49] 10.222.0.86 () {60 vars in 1193 bytes} [Mon Aug 29 18:55:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 18:55:12.391474 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-c7da541c-258d-446a-9659-565e156ccfa6 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:12.406432 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-c7da541c-258d-446a-9659-565e156ccfa6 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018513 Aug 29 18:55:12.406944 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 26/50] 10.222.0.86 () {60 vars in 1210 bytes} [Mon Aug 29 18:55:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 18:55:12.416958 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-17bbfcd2-766c-4a61-8937-78b8d90d42f0 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:12.431533 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-17bbfcd2-766c-4a61-8937-78b8d90d42f0 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018753 Aug 29 18:55:12.432044 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 25/51] 10.222.0.86 () {60 vars in 1210 bytes} [Mon Aug 29 18:55:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 18:55:12.441156 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-5ef29888-1900-490d-8a79-af06b60caf1a admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:12.446328 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.wsgi [None req-5ef29888-1900-490d-8a79-af06b60caf1a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-5ef29888-1900-490d-8a79-af06b60caf1a admin admin] Request method failure captured: Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Accept: application/json Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Accept-Encoding: gzip, deflate Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Connection: keep-alive Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Content-Length: 0 Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Host: 10.222.0.86 Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Openstack-Api-Version: compute 2.90 Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Openstack-System-Scope: None Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: User-Agent: python-novaclient Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Auth-Token: gAAAAABjDQuPYrbNPjL5_WbSerQerMi0PfdZZp1iRq9vzdoxkBfW2TYYsWn5jvSudb25STlTohcK4XKW7IijfA_sXlW1OHsU9cHQkHwGhJXO4i8hNJIwlnFSLxQOTrpUsN44sWMiTgbyJvhOLIws0yuiIQ7OQTo_NrVKR9TtrzRlaoiWr_J1dtc Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Domain-Id: None Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Domain-Name: None Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Identity-Status: Confirmed Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Is-Admin-Project: True Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Project-Domain-Id: default Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Project-Domain-Name: Default Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Project-Id: 3e9f996197414d24b783bd100f720103 Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Project-Name: admin Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Role: reader,admin,member Aug 29 18:55:12.447849 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Roles: reader,admin,member Aug 29 18:55:12.450564 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/3e9f996197414d24b783bd100f720103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/3e9f996197414d24b783bd100f720103"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/3e9f996197414d24b783bd100f720103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_3e9f996197414d24b783bd100f720103"}]}] Aug 29 18:55:12.450564 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Tenant: admin Aug 29 18:55:12.450564 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Tenant-Id: 3e9f996197414d24b783bd100f720103 Aug 29 18:55:12.450564 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-Tenant-Name: admin Aug 29 18:55:12.450564 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-User: admin Aug 29 18:55:12.450564 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-User-Domain-Id: default Aug 29 18:55:12.450564 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-User-Domain-Name: Default Aug 29 18:55:12.450564 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-User-Id: 9c8f433f2f1f4923859810dc0019845c Aug 29 18:55:12.450564 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: X-User-Name: admin Aug 29 18:55:12.450564 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: method: > Aug 29 18:55:12.450564 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: exception: Flavor 451 could not be found. Aug 29 18:55:12.450564 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: action_args: {'id': '451'} Aug 29 18:55:12.450564 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 18:55:12.450564 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 18:55:12.452162 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Aug 29 18:55:12.454206 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-5ef29888-1900-490d-8a79-af06b60caf1a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 18:55:12.456021 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-5ef29888-1900-490d-8a79-af06b60caf1a admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011485 Aug 29 18:55:12.456021 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 27/52] 10.222.0.86 () {60 vars in 1193 bytes} [Mon Aug 29 18:55:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 18:55:13.443387 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-17bbfcd2-766c-4a61-8937-78b8d90d42f0 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:13.444412 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-17bbfcd2-766c-4a61-8937-78b8d90d42f0 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 Aug 29 18:55:13.444798 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 26/53] 10.222.0.86 () {56 vars in 1074 bytes} [Mon Aug 29 18:55:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:55:13.970453 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-d42fa70f-bad5-4b7f-8c8e-7b4613ceb9e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:55:13.990447 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-d42fa70f-bad5-4b7f-8c8e-7b4613ceb9e2 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.403426 Aug 29 18:55:13.991014 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 28/54] 10.222.0.86 () {64 vars in 1235 bytes} [Mon Aug 29 18:55:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 18:55:14.957583 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-17bbfcd2-766c-4a61-8937-78b8d90d42f0 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:14.958592 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-17bbfcd2-766c-4a61-8937-78b8d90d42f0 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 29 18:55:14.958983 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 27/55] 10.222.0.86 () {56 vars in 1074 bytes} [Mon Aug 29 18:55:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:55:15.485051 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-d6bb6d16-2134-4a97-af9e-2a1b2d046f85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:55:15.502987 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-d6bb6d16-2134-4a97-af9e-2a1b2d046f85 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.402118 Aug 29 18:55:15.503506 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 29/56] 10.222.0.86 () {64 vars in 1235 bytes} [Mon Aug 29 18:55:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 18:55:16.489989 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-17bbfcd2-766c-4a61-8937-78b8d90d42f0 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:16.491049 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-17bbfcd2-766c-4a61-8937-78b8d90d42f0 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 29 18:55:16.491441 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 28/57] 10.222.0.86 () {56 vars in 1074 bytes} [Mon Aug 29 18:55:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:55:17.014372 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-062f5488-dffb-430f-9f78-df95c133a243 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:55:17.033300 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-062f5488-dffb-430f-9f78-df95c133a243 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.403620 Aug 29 18:55:17.033834 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 30/58] 10.222.0.86 () {64 vars in 1235 bytes} [Mon Aug 29 18:55:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 18:55:18.001423 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-17bbfcd2-766c-4a61-8937-78b8d90d42f0 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:18.002426 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-17bbfcd2-766c-4a61-8937-78b8d90d42f0 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 29 18:55:18.002813 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 29/59] 10.222.0.86 () {56 vars in 1074 bytes} [Mon Aug 29 18:55:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:55:18.529948 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-d2b67327-6977-4c0f-b1ff-f2467dbe452f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 18:55:18.548442 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-d2b67327-6977-4c0f-b1ff-f2467dbe452f admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.406514 Aug 29 18:55:18.548980 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 31/60] 10.222.0.86 () {64 vars in 1235 bytes} [Mon Aug 29 18:55:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 18:55:19.528776 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-17bbfcd2-766c-4a61-8937-78b8d90d42f0 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:19.529785 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-17bbfcd2-766c-4a61-8937-78b8d90d42f0 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 29 18:55:19.530173 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 30/61] 10.222.0.86 () {56 vars in 1074 bytes} [Mon Aug 29 18:55:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:55:20.053327 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-37f41180-d668-4350-835c-304ea6c3107b admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:55:20.073853 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-37f41180-d668-4350-835c-304ea6c3107b admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.405486 Aug 29 18:55:20.074381 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 32/62] 10.222.0.86 () {60 vars in 1202 bytes} [Mon Aug 29 18:55:19 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 18:56:13.775294 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-17bbfcd2-766c-4a61-8937-78b8d90d42f0 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:56:13.776307 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-17bbfcd2-766c-4a61-8937-78b8d90d42f0 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 29 18:56:13.776705 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 31/63] 10.222.0.86 () {54 vars in 931 bytes} [Mon Aug 29 18:56:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:56:13.791412 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:14.187044 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-c39a58ef-9d3b-4147-9e94-b2579e932b1e admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:56:14.209493 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-c39a58ef-9d3b-4147-9e94-b2579e932b1e admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.426459 Aug 29 18:56:14.209956 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 33/64] 10.222.0.86 () {60 vars in 1292 bytes} [Mon Aug 29 18:56:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 18:56:14.230784 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_api:SELECT=14 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:14.234542 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-124c04a3-8f21-4529-95eb-f92bc34890c4 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:56:14.242586 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-124c04a3-8f21-4529-95eb-f92bc34890c4 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013198 Aug 29 18:56:14.243146 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 32/65] 10.222.0.86 () {60 vars in 1283 bytes} [Mon Aug 29 18:56:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 18:56:14.255326 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-d4d3e5ac-1467-4123-af68-943d74f65ed3 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:56:14.262842 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-d4d3e5ac-1467-4123-af68-943d74f65ed3 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011751 Aug 29 18:56:14.263396 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 34/66] 10.222.0.86 () {60 vars in 1286 bytes} [Mon Aug 29 18:56:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 18:56:14.275270 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-37e0d8ee-37b4-4744-90e6-8a8161f3835d admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:56:14.282684 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-37e0d8ee-37b4-4744-90e6-8a8161f3835d admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011634 Aug 29 18:56:14.283223 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 33/67] 10.222.0.86 () {60 vars in 1286 bytes} [Mon Aug 29 18:56:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 18:56:14.294486 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-7b5b4e95-af02-4637-b4ad-7a2ce8087f71 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:56:14.303041 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-7b5b4e95-af02-4637-b4ad-7a2ce8087f71 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012000 Aug 29 18:56:14.303572 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 35/68] 10.222.0.86 () {60 vars in 1283 bytes} [Mon Aug 29 18:56:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 18:59:25.621747 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-37e0d8ee-37b4-4744-90e6-8a8161f3835d admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:59:25.623033 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-37e0d8ee-37b4-4744-90e6-8a8161f3835d admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 29 18:59:25.623129 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 34/69] 10.222.0.86 () {56 vars in 1074 bytes} [Mon Aug 29 18:59:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:59:25.765753 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_api:SELECT=6 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:25.926395 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-28061629-9242-4a83-893b-1be82c37063d admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:59:25.929893 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-28061629-9242-4a83-893b-1be82c37063d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:59:25.930364 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-28061629-9242-4a83-893b-1be82c37063d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:59:25.930794 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-28061629-9242-4a83-893b-1be82c37063d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:59:25.931617 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-28061629-9242-4a83-893b-1be82c37063d admin admin] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:59:25.932067 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-28061629-9242-4a83-893b-1be82c37063d admin admin] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:59:25.932484 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-28061629-9242-4a83-893b-1be82c37063d admin admin] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:59:25.966092 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-28061629-9242-4a83-893b-1be82c37063d admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.201642 Aug 29 18:59:25.966574 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 36/70] 10.222.0.86 () {60 vars in 1193 bytes} [Mon Aug 29 18:59:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 18:59:26.785355 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-37e0d8ee-37b4-4744-90e6-8a8161f3835d admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:59:26.786394 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-37e0d8ee-37b4-4744-90e6-8a8161f3835d admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 29 18:59:26.786785 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 35/71] 10.222.0.86 () {56 vars in 1074 bytes} [Mon Aug 29 18:59:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:59:26.975797 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-80b9a8aa-3d89-44bb-8799-3d1329fea3ba admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:59:26.979228 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-80b9a8aa-3d89-44bb-8799-3d1329fea3ba admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:59:26.979694 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-80b9a8aa-3d89-44bb-8799-3d1329fea3ba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:59:26.980109 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-80b9a8aa-3d89-44bb-8799-3d1329fea3ba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:59:26.980800 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-80b9a8aa-3d89-44bb-8799-3d1329fea3ba admin admin] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:59:26.981232 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-80b9a8aa-3d89-44bb-8799-3d1329fea3ba admin admin] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:59:26.981636 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-80b9a8aa-3d89-44bb-8799-3d1329fea3ba admin admin] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:59:27.001112 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-80b9a8aa-3d89-44bb-8799-3d1329fea3ba admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075765 Aug 29 18:59:27.001644 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 37/72] 10.222.0.86 () {60 vars in 1193 bytes} [Mon Aug 29 18:59:26 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 18:59:38.222627 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-37e0d8ee-37b4-4744-90e6-8a8161f3835d admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:59:38.223663 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-37e0d8ee-37b4-4744-90e6-8a8161f3835d admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 29 18:59:38.224059 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 36/73] 10.222.0.86 () {56 vars in 1074 bytes} [Mon Aug 29 18:59:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:59:38.368116 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_cell0:SELECT=4 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:38.368821 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_cell1:SELECT=4 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:38.369507 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_api:SELECT=8 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:38.417551 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-f2ecd951-115f-4a1b-a543-aa05bc274ada admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:59:38.420969 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-f2ecd951-115f-4a1b-a543-aa05bc274ada admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:59:38.421434 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-f2ecd951-115f-4a1b-a543-aa05bc274ada admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:59:38.421852 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-f2ecd951-115f-4a1b-a543-aa05bc274ada admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:59:38.423092 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-f2ecd951-115f-4a1b-a543-aa05bc274ada admin admin] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:59:38.423528 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-f2ecd951-115f-4a1b-a543-aa05bc274ada admin admin] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:59:38.423934 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-f2ecd951-115f-4a1b-a543-aa05bc274ada admin admin] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:59:38.443707 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-f2ecd951-115f-4a1b-a543-aa05bc274ada admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079859 Aug 29 18:59:38.444169 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 38/74] 10.222.0.86 () {60 vars in 1193 bytes} [Mon Aug 29 18:59:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 18:59:39.283509 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-37e0d8ee-37b4-4744-90e6-8a8161f3835d admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:59:39.284508 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-37e0d8ee-37b4-4744-90e6-8a8161f3835d admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 29 18:59:39.284901 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 37/75] 10.222.0.86 () {56 vars in 1074 bytes} [Mon Aug 29 18:59:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:59:39.473791 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-8d5a9a81-e2f3-44e4-955e-e14f9d4ba419 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:59:39.477342 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-8d5a9a81-e2f3-44e4-955e-e14f9d4ba419 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:59:39.477808 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-8d5a9a81-e2f3-44e4-955e-e14f9d4ba419 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:59:39.478252 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-8d5a9a81-e2f3-44e4-955e-e14f9d4ba419 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:59:39.478977 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-8d5a9a81-e2f3-44e4-955e-e14f9d4ba419 admin admin] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:59:39.479438 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-8d5a9a81-e2f3-44e4-955e-e14f9d4ba419 admin admin] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:59:39.479847 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-8d5a9a81-e2f3-44e4-955e-e14f9d4ba419 admin admin] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:59:39.506112 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-8d5a9a81-e2f3-44e4-955e-e14f9d4ba419 admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082928 Aug 29 18:59:39.506617 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 39/76] 10.222.0.86 () {60 vars in 1193 bytes} [Mon Aug 29 18:59:39 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 18:59:50.751316 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-37e0d8ee-37b4-4744-90e6-8a8161f3835d admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:59:50.752311 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-37e0d8ee-37b4-4744-90e6-8a8161f3835d admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001976 Aug 29 18:59:50.752703 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 38/77] 10.222.0.86 () {56 vars in 1074 bytes} [Mon Aug 29 18:59:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 18:59:50.896676 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_cell0:SELECT=4 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:50.897385 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_cell1:SELECT=4 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:50.898048 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_api:SELECT=8 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:50.945782 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-d0889e9d-27ee-415b-9649-680ba9d0b375 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:59:50.949135 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-d0889e9d-27ee-415b-9649-680ba9d0b375 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:59:50.949607 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-d0889e9d-27ee-415b-9649-680ba9d0b375 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:59:50.950031 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-d0889e9d-27ee-415b-9649-680ba9d0b375 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:59:50.950729 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-d0889e9d-27ee-415b-9649-680ba9d0b375 admin admin] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:59:50.951196 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-d0889e9d-27ee-415b-9649-680ba9d0b375 admin admin] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:59:50.951604 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-d0889e9d-27ee-415b-9649-680ba9d0b375 admin admin] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:59:50.973335 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-d0889e9d-27ee-415b-9649-680ba9d0b375 admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081075 Aug 29 18:59:50.973868 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 40/78] 10.222.0.86 () {60 vars in 1193 bytes} [Mon Aug 29 18:59:50 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 18:59:51.835634 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-37e0d8ee-37b4-4744-90e6-8a8161f3835d admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:59:51.836657 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-37e0d8ee-37b4-4744-90e6-8a8161f3835d admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 29 18:59:51.837118 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 39/79] 10.222.0.86 () {56 vars in 1074 bytes} [Mon Aug 29 18:59:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:59:52.037442 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-4f11987c-cc7e-41b0-b1a1-4f88404ff4cd admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:59:52.041471 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-4f11987c-cc7e-41b0-b1a1-4f88404ff4cd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:59:52.041942 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-4f11987c-cc7e-41b0-b1a1-4f88404ff4cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:59:52.042364 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-4f11987c-cc7e-41b0-b1a1-4f88404ff4cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:59:52.043236 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-4f11987c-cc7e-41b0-b1a1-4f88404ff4cd admin admin] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:59:52.043673 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-4f11987c-cc7e-41b0-b1a1-4f88404ff4cd admin admin] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:59:52.044089 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-4f11987c-cc7e-41b0-b1a1-4f88404ff4cd admin admin] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:59:52.066502 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-4f11987c-cc7e-41b0-b1a1-4f88404ff4cd admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081527 Aug 29 18:59:52.067062 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 41/80] 10.222.0.86 () {60 vars in 1193 bytes} [Mon Aug 29 18:59:51 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:00:51.713972 dv-cinder-850830-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 19:00:51.714543 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: Mon Aug 29 19:00:51 2022 - graceful shutdown triggered... Aug 29 19:00:51.714967 dv-cinder-850830-2-iscsi devstack@n-api.service[105476]: Gracefully killing worker 1 (pid: 105476)... Aug 29 19:00:51.715515 dv-cinder-850830-2-iscsi devstack@n-api.service[105477]: Gracefully killing worker 2 (pid: 105477)... Aug 29 19:00:52.715327 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: worker 1 buried after 1 seconds Aug 29 19:00:52.715864 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: worker 2 buried after 1 seconds Aug 29 19:00:52.715864 dv-cinder-850830-2-iscsi devstack@n-api.service[105475]: goodbye to uWSGI. Aug 29 19:00:52.716967 dv-cinder-850830-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 29 19:00:52.717509 dv-cinder-850830-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 19:00:52.720353 dv-cinder-850830-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 19:00:52.732183 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 19:00:52.734795 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 19:00:52 2022] *** Aug 29 19:00:52.734795 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 19:00:52.734795 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 19:00:52.734795 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: nodename: dv-cinder-850830-2-iscsi Aug 29 19:00:52.734795 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: machine: x86_64 Aug 29 19:00:52.734795 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: clock source: unix Aug 29 19:00:52.734795 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: pcre jit disabled Aug 29 19:00:52.734795 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: detected number of CPU cores: 4 Aug 29 19:00:52.734795 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: current working directory: / Aug 29 19:00:52.734795 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: detected binary path: /usr/bin/uwsgi-core Aug 29 19:00:52.734795 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: your processes number limit is 47680 Aug 29 19:00:52.735693 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: your memory page size is 4096 bytes Aug 29 19:00:52.735693 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: detected max file descriptor number: 2048 Aug 29 19:00:52.735693 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: lock engine: pthread robust mutexes Aug 29 19:00:52.735693 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: thunder lock: enabled Aug 29 19:00:52.735693 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 19:00:52.735693 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 19:00:52.774797 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: Python main interpreter initialized at 0x55d74a13b9c0 Aug 29 19:00:52.774797 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: python threads support enabled Aug 29 19:00:52.774797 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: your server socket listen backlog is limited to 100 connections Aug 29 19:00:52.774797 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: your mercy for graceful operations on workers is 90 seconds Aug 29 19:00:52.775255 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 19:00:52.775255 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: *** Operational MODE: preforking *** Aug 29 19:00:52.775492 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: *** uWSGI is running in multiple interpreter mode *** Aug 29 19:00:52.775492 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: spawned uWSGI master process (pid: 120696) Aug 29 19:00:52.775696 dv-cinder-850830-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 19:00:52.776276 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: spawned uWSGI worker 1 (pid: 120707, cores: 1) Aug 29 19:00:52.777118 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: spawned uWSGI worker 2 (pid: 120708, cores: 1) Aug 29 19:00:52.777118 dv-cinder-850830-2-iscsi devstack@n-api.service[120696]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 19:00:53.444002 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 19:00:53.447328 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 19:00:54.627416 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:00:54.627416 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: from cryptography.utils import int_from_bytes Aug 29 19:00:54.628765 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:00:54.628765 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: from cryptography.utils import int_from_bytes Aug 29 19:00:54.684428 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:00:54.684428 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: from cryptography.utils import int_from_bytes Aug 29 19:00:54.685022 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:00:54.685022 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: from cryptography.utils import int_from_bytes Aug 29 19:00:57.107074 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 19:00:57.107692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 19:00:57.108158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 19:00:57.108265 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 19:00:57.108509 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 19:00:57.109065 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.109470 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.109738 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.110034 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.110478 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.110816 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.111179 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.111538 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.111909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.112379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.112703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.113032 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850830-2-iscsi {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.113358 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.113723 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.114028 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.114354 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.114670 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.115041 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.115353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.115862 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.117234 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.117234 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.117234 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.117653 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.117869 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.118176 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.118498 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.118821 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.119164 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.119475 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.119883 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850830-2-iscsi {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.120202 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.120517 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.120819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.121242 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.121556 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.121866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.122180 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.122505 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.122807 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.123162 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.123475 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.123796 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.124116 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.124417 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.124726 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.125036 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.125356 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.125661 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.125965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.126212 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.126518 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.126840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.127237 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.127569 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.128011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.128264 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.128584 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.128903 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.129212 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.129520 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.129825 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.130130 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.130435 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.130740 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.131062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.131372 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.131689 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.132003 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.132321 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.132629 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.132946 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.133364 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.133620 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.133922 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.134265 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.134583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.134894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.135241 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.135559 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.135866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.136023 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 19:00:57.136501 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.136654 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 19:00:57.136821 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.136964 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 19:00:57.137115 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.137265 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 19:00:57.137410 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.137565 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 19:00:57.137711 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.137711 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.137999 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.138148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.138296 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.138452 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.138595 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.138757 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.138908 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.139086 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.139246 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.139399 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.139549 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.139692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.139862 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.140020 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.140172 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.140333 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.140491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.140637 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.140796 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.140948 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.141107 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.141258 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.141438 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850830-2-iscsi {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.141594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.141737 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.141878 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.142033 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.142184 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.142350 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.142506 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.142686 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.143357 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.143520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.143689 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.143847 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.144000 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.144714 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.144902 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.145058 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.145291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.145440 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.145602 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.145751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.145979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.146132 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.146423 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.146423 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.146757 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.146911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.147098 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.147261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.147405 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.147556 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.147705 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.147870 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.148019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.148161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.148319 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.148470 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.148612 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.148760 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.148901 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850830-2-iscsi {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.149058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.149200 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.149343 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.149493 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.149643 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.149806 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.150007 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.150190 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.150335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.150496 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.150649 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.150791 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.150946 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.151112 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.151267 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.151419 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.151570 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.151736 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.151879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.151879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.152165 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.152307 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.152455 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.152618 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.152769 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.152918 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.153059 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.153220 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.153371 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.153528 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.153688 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.153839 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.153988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.154130 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.154539 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.155073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.155288 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.155440 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.155583 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.155583 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.155874 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.156017 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.156173 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.156352 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.156639 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.156797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.156956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.157108 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.157262 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.157405 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.157593 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.157756 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.157909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.158051 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.158205 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.158533 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.159228 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.160156 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.160315 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.160460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.160603 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.160765 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.160911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.161064 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.161207 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.161350 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.161491 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.161653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.161653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.161948 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.162091 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.162233 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.162383 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.162526 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.162684 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.162864 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.163051 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.163212 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.163364 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.163533 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.163686 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.163836 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.163985 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.164130 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.164271 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.164656 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.165157 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.165376 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.165534 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.165679 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.165830 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.165982 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.166222 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.166372 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.166521 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.166827 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.166975 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.167160 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.167314 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.167457 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.167609 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.167759 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.167901 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.168056 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.168206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.168368 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.168519 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.168662 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.168804 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.168804 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.169091 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.169245 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.169399 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.169548 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.169699 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.169851 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.169993 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.170142 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.170302 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.170445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.170596 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.170757 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.170907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.171102 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.171260 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.171410 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.171568 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.171719 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.171869 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.172023 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.172193 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.172425 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.172584 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.172736 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.172879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.173021 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.173163 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.173305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.173461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.173645 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.173800 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.173951 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.174167 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.174337 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.174502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.175575 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.175744 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.175891 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.176043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.176203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.176347 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.176489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.176633 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.176958 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.177205 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.177365 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.177524 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.177669 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.177811 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.177952 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.178113 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.178265 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.178409 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.178559 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.178711 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.178906 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.179106 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.179255 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.179398 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.179562 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.179714 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.179872 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.180022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.180172 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.180315 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.180465 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.180608 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.180767 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.180922 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.181066 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.181208 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.181358 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.181519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.181675 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.181828 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.181979 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.182165 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.182346 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.182506 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.182656 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.182806 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.182960 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.183130 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.183273 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.183438 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.183582 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.183723 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.183865 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.184016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.184165 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.184324 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.184475 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.184625 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.184768 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.185024 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.185574 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.185574 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.185974 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.186120 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:00:57.186263 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.186263 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.186554 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.186707 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.186857 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.187196 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.187350 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.187501 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.187653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.187845 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.187995 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.188152 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.188302 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.188452 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.188608 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.188753 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.188895 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.189037 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.189187 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.189340 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.189483 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.189679 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.189830 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.190081 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.190507 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.190674 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.190943 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.191125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.191274 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.191430 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.191582 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.191735 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.191879 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.192029 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.192172 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.192323 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.192731 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.192893 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.193044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.193195 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.193345 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.193489 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.193644 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.193788 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.193930 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.194073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.194213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.194354 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.194512 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.194674 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.194824 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.194986 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.195244 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.195795 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.196045 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.196203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.196355 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.196499 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.196653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.196805 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.196957 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.197294 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.197586 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.197748 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.197891 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.198048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.198191 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.198343 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.198485 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.198637 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.198637 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.198915 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.199102 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.199249 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.199403 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.199558 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.199703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.199861 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.200013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.200156 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.200306 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.200444 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.200541 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.200659 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.200748 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.200846 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.200846 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.201010 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.201010 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.201175 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.201263 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.201345 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.201424 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.201509 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.201596 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.201674 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.201753 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.201832 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.201911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.201989 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.202073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.202152 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.202224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.202293 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.202363 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.202438 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.202438 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.202581 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.202651 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.202729 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.202808 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.202880 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.202962 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.203211 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.203294 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.203379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.203460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.203614 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.203689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.203769 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.203840 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.203919 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.203990 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.204073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.204154 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.204227 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.204297 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.204368 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.204437 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.204517 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.204517 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.204652 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.204652 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.204652 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.204652 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.204652 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.204990 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.205068 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.205140 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.206388 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.206487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.206571 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.206644 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.206714 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.206714 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.206849 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.206935 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.207026 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.207113 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.207187 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.207274 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.207504 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.207617 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.207700 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.207788 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.207875 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.207947 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.208028 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.208109 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.208189 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.208391 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.208504 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.208595 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.208688 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.208775 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.208853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.208937 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.209011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.209088 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.209168 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.209247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.209319 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.209396 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.209474 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.209545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.209623 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.209702 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.209773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.209850 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.209929 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.210006 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.210092 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.210172 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.210250 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.210329 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.210401 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.210483 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.210563 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.210642 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.210715 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.210799 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.210879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.211034 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.211128 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.211210 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.211288 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.211372 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.211445 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.211538 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.211619 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.211690 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.211859 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.211942 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.212160 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.212257 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.212461 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.212551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.212788 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.212867 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.213091 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.213174 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.213402 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.213483 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.213719 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.213842 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.214050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.214133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.214367 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.214457 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.214678 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.214769 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.215014 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.215112 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.215330 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.215419 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.215636 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.215730 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.215941 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.216047 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.216047 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.216690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.216785 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.216871 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.216970 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.217132 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.217232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.217544 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.217651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.217747 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.217834 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.218045 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.218158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.218893 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.219029 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.219179 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.219281 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.219384 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.219481 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.219576 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.219662 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.219755 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.219842 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.219950 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.220042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.220270 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.220362 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.220578 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.220668 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.220941 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.221678 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.221869 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.221946 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.222083 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.222174 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.222394 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.222487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.222703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.222794 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.223195 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.223317 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.223451 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.223619 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.223740 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.223852 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.223962 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.224079 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.224215 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.224329 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.224526 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.224653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.224839 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.224959 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.225142 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.225276 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.226910 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.227074 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.227196 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.227319 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.227447 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.227601 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.227854 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.227975 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.228087 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.228205 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.228330 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.228450 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.228562 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.228673 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.228791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.228917 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.228917 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.229238 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.229351 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.229473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.229584 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.229706 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.229824 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.229945 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.230057 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.230176 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.230294 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.230414 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.230525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.230643 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.230761 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.230872 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.231148 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.231287 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.231399 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.231511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.231620 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.231756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.232416 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.232539 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.232658 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.232777 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.232888 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.233006 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.233126 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.233246 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.233372 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.233490 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.233601 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.233710 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.233833 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.233945 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.234062 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.234187 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.234304 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.234423 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.234547 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.234658 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.234775 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.234894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.235025 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.235172 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.235306 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.235425 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.235542 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.235654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.235764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.235906 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.236138 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.236295 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.236295 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.236758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.237154 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.237296 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.237419 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.237530 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.237639 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.237895 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.238022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.238216 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.238332 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.238484 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.238601 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.238712 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.238832 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.238943 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.239152 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.239347 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.239471 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.239591 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.239718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.239829 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.239939 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.240055 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.240166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.240275 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.240397 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.240508 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.240629 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.240740 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.240857 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.240969 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.241091 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.241202 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.241312 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.241431 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.241553 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.241675 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.241794 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.241904 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.242014 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.242129 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.242343 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.242473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.242681 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.242804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.242979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.243180 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.243314 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.243447 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.243589 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.243716 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.243890 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.244009 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.244191 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.244325 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.244512 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.244631 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.244818 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.244946 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.245119 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.245248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.245421 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.245540 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.245721 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.245842 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.246063 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.246182 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.246369 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.246536 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.246872 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.247062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.247420 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.247542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.247660 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.247782 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.248047 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.248177 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.248297 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.248409 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.248520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.248644 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.248755 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.248873 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.248985 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.249103 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.249221 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.249366 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.249547 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.249662 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.249780 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.249893 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.250003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.250121 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.250240 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.250358 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.250477 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.250665 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.250794 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.250975 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.251138 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.251307 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.251436 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.251627 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.251761 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.251949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.252069 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.252855 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.252982 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.253111 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.253234 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.253373 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.253526 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.253683 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.253831 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.253991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.254124 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.254298 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.254445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.254607 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.254748 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.254918 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.255087 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.255257 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.255376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.255571 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.255691 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.255883 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.256010 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.256194 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.256314 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.256500 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.256619 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.256954 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.257931 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.258212 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.258340 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.258462 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.258573 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.258929 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.259121 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.259253 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.259366 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.259366 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.259663 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.259791 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.259905 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.260030 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.260143 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.260262 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.260382 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.260495 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.260605 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.260730 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.260843 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.260954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.261064 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.261173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.261297 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.261417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.261529 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.261639 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.261750 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.261859 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.261979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.262099 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.262218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.262329 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.262439 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.262548 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.262669 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.262789 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.262789 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.263034 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.263152 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.263285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.263412 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.263531 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.263651 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.263770 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.263880 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.264076 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.264197 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.264309 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.264458 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.264632 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.264752 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.264959 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.265087 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.265265 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.265384 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.265569 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.265688 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.265874 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.265994 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.266197 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.266324 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.266502 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.266621 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.267054 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.267246 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.267374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.267809 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.268799 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.269004 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.269192 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.269379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.269580 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.269814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.269945 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.270070 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.270183 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.270294 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.270405 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.270555 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.270682 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.271125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.271246 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.271358 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.271652 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.271788 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.271902 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.272029 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.272149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.272252 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.272339 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.272430 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.272528 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.272623 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.272722 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.272816 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.272900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.272991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.273085 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.273179 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.273264 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.273355 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.273439 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.273523 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.273615 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.273700 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.273783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.273993 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.274130 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.274384 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.274502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.274818 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.274943 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.275071 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.275200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.275376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.275512 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.275676 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.275838 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.275979 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.276142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.276298 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.276447 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.276605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.276757 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.276913 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.277135 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.277297 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.277401 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.277541 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.277657 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.277923 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.278029 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.278236 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.278380 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.278473 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.278604 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.278757 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.278893 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.279087 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.279235 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.279399 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.279543 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.279714 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.279861 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.280024 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.280137 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.280338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.280447 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.280649 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.280758 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.280959 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.281058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.281267 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.281375 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.281573 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.281686 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.281887 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.282001 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.282197 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.282306 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.282500 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.282607 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.282823 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.282930 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.283154 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.283271 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.283486 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.283585 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.283798 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.283906 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.284118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.284216 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.284443 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.284541 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.284748 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.284855 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.285060 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.285191 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.285391 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.285490 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.285715 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.285810 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.286032 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.286128 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.286349 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.286449 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.286671 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.286773 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.286974 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.287132 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.287313 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.287415 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.287597 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.287703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.287966 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.288080 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.288196 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.288317 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.288505 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.288608 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.288812 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.288918 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.289110 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.289210 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.289413 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.289519 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.289717 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.289816 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.290039 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.290153 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.290343 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.290455 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.290661 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.290743 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.290966 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.291109 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.291289 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.291394 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.291595 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.291688 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.291899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.291992 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.292241 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.292342 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.292544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.292636 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.292871 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.292971 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.293182 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.293310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.293504 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.293604 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.293822 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.293920 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.294136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.294236 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.294452 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.294552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.294837 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.294941 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.295168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.295295 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.295483 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.295616 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.295794 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.295984 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.296118 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.296298 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.296440 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.296616 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.296749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.296932 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.297064 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.297270 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.297382 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.297678 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.297808 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.297997 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.298187 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.298309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.298459 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.298629 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.298775 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.299090 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.299201 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.299416 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.299577 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.299783 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.299917 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.300037 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.300303 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.300394 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.300638 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.300758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.300951 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.301065 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.301277 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.301386 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.301598 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.301699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.301910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.302006 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.302219 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.302302 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.302574 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.302685 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.302850 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.302943 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.303317 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.303635 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.303947 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.304253 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.304455 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.304674 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.304801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.305002 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.305182 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.305296 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.305514 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.305624 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.305838 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.305943 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.306206 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.306311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.306532 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.306630 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.306837 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.306980 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.307255 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.307370 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.307587 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.307699 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.307870 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.307963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.308176 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.308285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.308505 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.308613 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.308845 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.308948 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.309152 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.309292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.309463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.309562 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.309787 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.309903 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.310106 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.310197 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.310419 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.310516 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.310744 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.310854 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.311091 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.311194 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.311411 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.311529 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.311730 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.311977 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.312078 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.312296 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.312396 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.312628 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.312729 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.312938 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.313034 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.313240 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.313333 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.313543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.313650 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.313844 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.313937 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.314149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.314258 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.314447 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.314549 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.315312 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.315409 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.315837 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.315935 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.316030 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.316118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.316209 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.316295 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.316520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.316613 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.316831 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.316936 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.317135 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.317237 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.317441 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.317811 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.318010 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.318111 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.318353 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.318658 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.318762 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.318982 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.319125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.319320 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.319437 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.319648 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.319760 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.319970 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.320071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.320286 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.320394 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.320597 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.320693 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.320909 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.321016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.321215 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.321324 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.321522 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.321620 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.321835 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.321941 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.322142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.322240 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.322448 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.322567 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.322752 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.322855 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.323087 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.323197 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.323399 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.323639 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.323743 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.323970 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.324064 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.324286 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.324387 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.324600 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.324694 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.324905 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.325004 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.325213 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.325304 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.325518 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.325620 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.325825 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.325917 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.326125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.326214 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.326428 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.326529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.326732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.326832 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.327054 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.327165 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.327369 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.327462 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.327672 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.327772 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.327986 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.328111 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.328290 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.328398 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.328602 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.328712 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.328915 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.329027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.329228 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.329333 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.329571 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.329669 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.329884 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.329991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.330226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.330360 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.331245 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.331336 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.331439 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.331535 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.331686 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.331779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.332011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.332110 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.332327 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.332419 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.332639 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.332739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.332964 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.333065 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.333281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.333399 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.333598 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.333814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.333913 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.334155 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.334262 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.334482 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.334589 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.334818 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.334918 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.335174 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.335285 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.335484 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.335584 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.335794 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.335903 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.336105 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.336258 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.336427 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.336619 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.336730 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.336929 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.337041 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.337261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.337376 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.337585 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.337682 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.337909 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.338044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.338239 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.338353 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.338536 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.338666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.338848 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.338945 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.339176 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.339301 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.339578 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.339747 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.339880 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.339978 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.340093 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.340248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.340406 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.340529 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.340670 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.340816 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.340984 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.341106 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.341476 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.341646 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.341746 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.341853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.341998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.342115 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.342214 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.342461 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.342575 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.342789 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.342938 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.343138 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.343284 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.343437 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.343604 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.343720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.343817 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.344011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.344116 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.344336 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.344431 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.344647 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.344741 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.344949 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.345051 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.345251 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.345352 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.345565 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.345659 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.345900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.346006 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.346204 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.346306 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.346543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.346711 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.346916 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.347030 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.347153 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.347323 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.347458 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.347635 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.347768 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.347957 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.348057 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.348281 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.348374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.348597 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.348701 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.348943 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.349042 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.349256 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.349356 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.349567 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.349714 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.349870 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.349963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.350171 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.350262 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.350472 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.350573 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.350773 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.350867 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.351108 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.351218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.351422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.351529 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.351709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.351800 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.352010 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.352117 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.352317 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.352416 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.352619 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.352709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.352921 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.353017 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.353225 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.353315 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.353531 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.353624 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.353841 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.353947 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.354141 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.354240 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.354444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.354535 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.354744 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.354847 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.355072 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.355168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.355375 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.355477 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.355675 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.355769 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.355981 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.356082 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.356281 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.356373 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.356584 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.356843 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.356937 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.357218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.357317 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.357470 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.357576 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.357797 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.357898 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.358127 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.358227 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.358436 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.358568 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.358745 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.358851 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.359073 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.359184 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.359392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.359486 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.359703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.359851 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.360014 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.360110 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.360322 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.360425 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.360633 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.360732 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.360939 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.361030 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.361249 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.361343 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.361588 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.361709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.361891 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.361993 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.362199 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.362356 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.362514 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.362670 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.362822 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.363111 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.363208 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.363435 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.363540 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.363744 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.363837 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.364055 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.364149 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.364368 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.364459 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.364693 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.364794 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.365003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.365095 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.365317 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.365411 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.365629 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.365729 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.365934 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.366033 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.366241 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.366342 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.366547 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.366690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.366852 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.366953 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.367180 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.367272 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.367491 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.367602 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.367801 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.367894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.368102 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.368195 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.368407 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.368524 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.368720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.368832 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.369037 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.369150 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.369350 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.369452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.369673 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.369809 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.370001 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.370136 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.370310 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.370406 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.370623 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.370716 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.370945 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.371114 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.371284 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.371397 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.371677 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.371782 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.371952 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.372069 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.372274 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.372365 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.372586 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.372687 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.372888 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.372990 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.373188 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.373287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.373431 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 19:00:57.373515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.373784 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.374101 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.374411 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.374715 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.375028 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.375346 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.375648 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.375953 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.376256 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.376562 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.376871 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.377683 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.378060 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.378370 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.378671 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.378978 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.379300 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.379608 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.379913 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.380219 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.380518 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.380821 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.381124 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.381456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.381796 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.382109 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.382431 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.382742 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.383087 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.383398 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.383763 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.384083 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.384397 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.384705 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.385037 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.385348 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.385658 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.385967 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.386275 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.386584 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.386892 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.387249 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.387573 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.387879 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.388202 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.388518 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.388835 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.389502 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.389502 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.389999 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.390077 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.390357 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.390664 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.390973 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.391304 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.391617 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.391929 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.392238 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.392552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.393403 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.393731 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.394054 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.394362 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.394686 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.395025 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.395371 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.395682 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.396024 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.396348 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.396657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.396967 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.397266 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:00:57.397505 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 19:00:57.435535 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO dbcounter [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] Registered counter for database nova_api Aug 29 19:00:57.457238 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_db.sqlalchemy.engines [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:00:57.460400 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO dbcounter [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] Registered counter for database nova_api Aug 29 19:00:57.463931 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writer thread running {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:00:57.480114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_db.sqlalchemy.engines [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:00:57.486603 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writer thread running {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:00:57.520246 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.context [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d74fd249-f6b1-4f68-a608-7346562653bf(cell1) {{(pid=120708) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 19:00:57.524262 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:00:57.524743 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:00:57.526318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:00:57.527057 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:00:57.527500 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:00:57.529487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:00:57.531530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO dbcounter [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] Registered counter for database nova_cell0 Aug 29 19:00:57.535892 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO dbcounter [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] Registered counter for database nova_cell1 Aug 29 19:00:57.543740 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_db.sqlalchemy.engines [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:00:57.546234 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_db.sqlalchemy.engines [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:00:57.550315 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.context [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d74fd249-f6b1-4f68-a608-7346562653bf(cell1) {{(pid=120707) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 19:00:57.554498 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writer thread running {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:00:57.556106 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writer thread running {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:00:57.556229 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:00:57.556724 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:00:57.559051 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:00:57.559791 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:00:57.560234 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:00:57.562228 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:00:57.564281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO dbcounter [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] Registered counter for database nova_cell0 Aug 29 19:00:57.569175 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO dbcounter [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] Registered counter for database nova_cell1 Aug 29 19:00:57.577964 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_db.sqlalchemy.engines [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:00:57.580172 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_db.sqlalchemy.engines [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:00:57.585175 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writer thread running {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:00:57.588237 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writer thread running {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:00:57.706418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO dbcounter [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] Registered counter for database nova_cell0 Aug 29 19:00:57.713510 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_db.sqlalchemy.engines [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:00:57.717905 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writer thread running {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:00:57.735242 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO dbcounter [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] Registered counter for database nova_cell0 Aug 29 19:00:57.742562 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_db.sqlalchemy.engines [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:00:57.746877 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writer thread running {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:00:58.045325 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: WARNING keystonemiddleware.auth_token [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 19:00:58.053657 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: WARNING keystonemiddleware.auth_token [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 19:00:58.069427 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: WARNING keystonemiddleware.auth_token [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 19:00:58.078811 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: WARNING keystonemiddleware.auth_token [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 19:00:58.426140 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: WARNING keystonemiddleware.auth_token [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 19:00:58.432229 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: WARNING keystonemiddleware.auth_token [None req-f1cbecc4-16dd-4970-a1e4-4825868e3adc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 19:00:58.437675 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d74a13b9c0 pid: 120708 (default app) Aug 29 19:00:58.440157 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: WARNING keystonemiddleware.auth_token [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 19:00:58.446472 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: WARNING keystonemiddleware.auth_token [None req-96324276-5a4a-4dd7-886d-7a0cc5f2df67 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 19:00:58.451849 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d74a13b9c0 pid: 120707 (default app) Aug 29 19:01:34.044644 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:34.048222 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:34.049161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:34.049915 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:35.295494 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:35.298868 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:35.300083 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:35.302840 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:35.493915 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-298371a7-5d85-406e-a1e5-6b758b648092 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Action: 'create', calling method: .version_select at 0x7fb2badffe50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-638480996"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:36.529754 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-41c4da83-70dd-4183-9a08-04b6cea7cfe0 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] Action: 'create', calling method: .version_select at 0x7fb2bae01e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-181235186", "metadata": {"Type": "work"}}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:37.664659 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-298371a7-5d85-406e-a1e5-6b758b648092 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.635945 Aug 29 19:01:37.665366 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 1/1] 10.222.0.86 () {60 vars in 1155 bytes} [Mon Aug 29 19:01:34 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3638 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 19:01:37.695205 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e2cf362c-1325-44f8-837d-16f4d97af3ca tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bac86ca0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:38.133473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e2cf362c-1325-44f8-837d-16f4d97af3ca tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819" status: 200 len: 344 microversion: 2.1 time: 0.451604 Aug 29 19:01:38.134039 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 2/2] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:37 2022] GET /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 => generated 344 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:38.201897 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-41c4da83-70dd-4183-9a08-04b6cea7cfe0 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.924198 Aug 29 19:01:38.202542 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 1/3] 10.222.0.86 () {60 vars in 1156 bytes} [Mon Aug 29 19:01:35 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2927 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 19:01:38.217287 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-21e9eee4-a59c-4090-8d03-ced0649dd315 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] Calling method '.version_select at 0x7fb2bac9b3a0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:38.298149 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-21e9eee4-a59c-4090-8d03-ced0649dd315 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378" status: 200 len: 352 microversion: 2.1 time: 0.084206 Aug 29 19:01:38.298722 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 3/4] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:38 2022] GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378 => generated 352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:39.148120 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e2131b07-ff55-4427-9019-d372ef2860b9 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bac85ca0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:39.220216 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e2131b07-ff55-4427-9019-d372ef2860b9 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819" status: 200 len: 345 microversion: 2.1 time: 0.075365 Aug 29 19:01:39.221640 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 2/5] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:39 2022] GET /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:39.237421 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4dbef50f-db0b-44ca-bca9-606eb995aa46 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Action: 'create', calling method: .version_select at 0x7fb2bac9ba60>, body: {"snapshot": {"volume_id": "d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2147322946"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:39.312033 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-956dcc3d-fe10-4945-9d73-bb8f21427cd4 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] Calling method '.version_select at 0x7fb2bac9b430>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:39.458305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-956dcc3d-fe10-4945-9d73-bb8f21427cd4 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378" status: 200 len: 352 microversion: 2.1 time: 0.149639 Aug 29 19:01:39.459625 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 3/6] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:39 2022] GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378 => generated 352 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:01:40.012871 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4dbef50f-db0b-44ca-bca9-606eb995aa46 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.782511 Aug 29 19:01:40.013445 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 4/7] 10.222.0.86 () {60 vars in 1162 bytes} [Mon Aug 29 19:01:39 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:01:40.025889 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e83c7df4-559e-4348-84e7-8fa967d44802 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bac9bb80>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:40.115284 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e83c7df4-559e-4348-84e7-8fa967d44802 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357" status: 200 len: 287 microversion: 2.1 time: 0.094273 Aug 29 19:01:40.116100 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 4/8] 10.222.0.86 () {58 vars in 1251 bytes} [Mon Aug 29 19:01:40 2022] GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:40.138316 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7ad2457b-a89f-42c8-a138-3979a110c27c tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bac9bdc0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:40.244593 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7ad2457b-a89f-42c8-a138-3979a110c27c tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.120666 Aug 29 19:01:40.251328 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 5/9] 10.222.0.86 () {58 vars in 1140 bytes} [Mon Aug 29 19:01:40 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:40.256595 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b5fbab3f-6e70-4da4-ba52-65cabc44d813 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bac85c10>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:40.321772 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b5fbab3f-6e70-4da4-ba52-65cabc44d813 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357" status: 200 len: 287 microversion: 2.1 time: 0.069105 Aug 29 19:01:40.322543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 5/10] 10.222.0.86 () {58 vars in 1251 bytes} [Mon Aug 29 19:01:40 2022] GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:01:40.474203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ef2b445e-6be5-4e19-841e-b91c554314ab tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] Calling method '.version_select at 0x7fb2badfff70>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:40.564915 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ef2b445e-6be5-4e19-841e-b91c554314ab tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378" status: 200 len: 353 microversion: 2.1 time: 0.096026 Aug 29 19:01:40.565569 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 6/11] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:40 2022] GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:40.578411 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-aee9f63b-8945-4f52-b4d2-4dd1d606f6ec tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] Calling method '.version_select at 0x7fb2bac9baf0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:40.656836 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-aee9f63b-8945-4f52-b4d2-4dd1d606f6ec tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378" status: 200 len: 353 microversion: 2.1 time: 0.082136 Aug 29 19:01:40.660917 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 6/12] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:40 2022] GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:40.683412 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-74cab360-d9db-4581-b34c-174d4317cfac tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] Calling method '.version_select at 0x7fb2bac22430>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:40.815368 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-74cab360-d9db-4581-b34c-174d4317cfac tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378" status: 202 len: 0 microversion: 2.1 time: 0.136152 Aug 29 19:01:40.815942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 7/13] 10.222.0.86 () {58 vars in 1248 bytes} [Mon Aug 29 19:01:40 2022] DELETE /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:01:40.824484 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c935b548-1a21-4772-9a62-4a01009d49e5 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] Calling method '.version_select at 0x7fb2bac9b3a0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:40.910200 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c935b548-1a21-4772-9a62-4a01009d49e5 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378" status: 200 len: 352 microversion: 2.1 time: 0.089420 Aug 29 19:01:40.912008 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 7/14] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:40 2022] GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378 => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:41.334313 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-57ea8a56-9427-4e02-8b6f-ad7f403261d0 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bac86f70>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:41.558923 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-57ea8a56-9427-4e02-8b6f-ad7f403261d0 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357" status: 200 len: 287 microversion: 2.1 time: 0.228949 Aug 29 19:01:41.560245 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 8/15] 10.222.0.86 () {58 vars in 1251 bytes} [Mon Aug 29 19:01:41 2022] GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357 => generated 287 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:41.926247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b582c167-5435-46ca-86ca-e4c71bb4f0ba tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] Calling method '.version_select at 0x7fb2bac9b310>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:42.053522 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b582c167-5435-46ca-86ca-e4c71bb4f0ba tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378" status: 200 len: 352 microversion: 2.1 time: 0.133054 Aug 29 19:01:42.054384 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 8/16] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:41 2022] GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378 => generated 352 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:42.577914 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0dbb38b1-9112-4ca5-aa5a-0fc2a6a9c8ed tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bac9b0d0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:42.652726 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0dbb38b1-9112-4ca5-aa5a-0fc2a6a9c8ed tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357" status: 200 len: 287 microversion: 2.1 time: 0.078591 Aug 29 19:01:42.653460 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 9/17] 10.222.0.86 () {58 vars in 1251 bytes} [Mon Aug 29 19:01:42 2022] GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:43.070555 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b7d6b426-11b5-456e-87ca-c793d816d9aa tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] Calling method '.version_select at 0x7fb2bac9baf0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:43.300298 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b7d6b426-11b5-456e-87ca-c793d816d9aa tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378" status: 200 len: 352 microversion: 2.1 time: 0.233375 Aug 29 19:01:43.307927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 9/18] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:43 2022] GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378 => generated 352 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:43.665653 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e59ac683-bdbc-47da-b99b-53efceb5f8a3 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bac9b9d0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:43.728445 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e59ac683-bdbc-47da-b99b-53efceb5f8a3 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357" status: 200 len: 287 microversion: 2.1 time: 0.066604 Aug 29 19:01:43.729284 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 10/19] 10.222.0.86 () {58 vars in 1251 bytes} [Mon Aug 29 19:01:43 2022] GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:44.313936 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4462066b-913a-4747-bd8c-1d28f615699a tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] Calling method '.version_select at 0x7fb2bac85c10>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:44.419790 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4462066b-913a-4747-bd8c-1d28f615699a tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378" status: 200 len: 352 microversion: 2.1 time: 0.109774 Aug 29 19:01:44.421000 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 10/20] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:44 2022] GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378 => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:44.741289 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9920d457-a5bc-4111-8b41-9dcc77d91f8b tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bac9b8b0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:44.792709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9920d457-a5bc-4111-8b41-9dcc77d91f8b tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357" status: 200 len: 287 microversion: 2.1 time: 0.055566 Aug 29 19:01:44.793486 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 11/21] 10.222.0.86 () {58 vars in 1251 bytes} [Mon Aug 29 19:01:44 2022] GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:45.435363 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-389c0f21-7e47-43fb-8ebf-b54a49cc852b tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] Calling method '.version_select at 0x7fb2bac283a0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:45.661287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-389c0f21-7e47-43fb-8ebf-b54a49cc852b tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378" status: 200 len: 352 microversion: 2.1 time: 0.230308 Aug 29 19:01:45.662347 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 11/22] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:45 2022] GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378 => generated 352 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:45.806064 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-82d216c9-dc4a-44a3-9945-7514d18c7290 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bac9b550>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:45.873890 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-82d216c9-dc4a-44a3-9945-7514d18c7290 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357" status: 200 len: 287 microversion: 2.1 time: 0.072153 Aug 29 19:01:45.874935 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 12/23] 10.222.0.86 () {58 vars in 1251 bytes} [Mon Aug 29 19:01:45 2022] GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:46.676861 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-13bf469c-6249-43f7-8384-205068b9bd47 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] Calling method '.version_select at 0x7fb2bac85dc0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:46.797879 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-13bf469c-6249-43f7-8384-205068b9bd47 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378" status: 200 len: 352 microversion: 2.1 time: 0.125774 Aug 29 19:01:46.799284 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 12/24] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:46 2022] GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378 => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:46.886715 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ddd765bd-7c3c-40b5-80ed-17e2799bf542 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bac86a60>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:46.959187 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ddd765bd-7c3c-40b5-80ed-17e2799bf542 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357" status: 200 len: 287 microversion: 2.1 time: 0.076371 Aug 29 19:01:46.964412 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 13/25] 10.222.0.86 () {58 vars in 1251 bytes} [Mon Aug 29 19:01:46 2022] GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:47.811377 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bf13e847-68ab-4a4e-8e93-97b19bd5b061 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] Calling method '.version_select at 0x7fb2bac9bc10>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:47.906095 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bf13e847-68ab-4a4e-8e93-97b19bd5b061 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378" status: 200 len: 352 microversion: 2.1 time: 0.098638 Aug 29 19:01:47.907661 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 13/26] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:47 2022] GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:47.978766 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b559e458-110f-48ba-87b3-627dba825f43 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bac9b430>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:48.028573 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b559e458-110f-48ba-87b3-627dba825f43 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357" status: 200 len: 288 microversion: 2.1 time: 0.053409 Aug 29 19:01:48.029386 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 14/27] 10.222.0.86 () {58 vars in 1251 bytes} [Mon Aug 29 19:01:47 2022] GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357 => generated 288 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:48.044471 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8bf49892-0ce2-419c-94d2-d25f3cfaf172 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bac28430>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:48.146410 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6f90d7ab-023a-4f7c-a9e8-54eb53f78a05 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Action: 'create', calling method: .version_select at 0x7fb2bac229d0>, body: {"keypair": {"name": "tempest-keypair-199651159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqfm0KlyYMv2exZki2HCDLqtz8iNGcL6gqxfStr4sbtNosTEB2JdVk116++H2CUKbT5GG24g0uY6cHOj2yO851EIeiWkXokDt0dDIbsaR6flkWwanlI6kfJvqZhcFZ0Zw=="}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:48.200906 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8bf49892-0ce2-419c-94d2-d25f3cfaf172 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "DELETE /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357" status: 202 len: 0 microversion: 2.1 time: 0.160119 Aug 29 19:01:48.201508 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 15/28] 10.222.0.86 () {58 vars in 1254 bytes} [Mon Aug 29 19:01:48 2022] DELETE /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:01:48.211543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3022c063-f378-401d-a0fd-9a5c39fa19b8 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bac9b310>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:48.260667 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-6f90d7ab-023a-4f7c-a9e8-54eb53f78a05 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Getting quotas for project b3171bab0ea547d9acc3559f449221eb. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:01:48.269470 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-6f90d7ab-023a-4f7c-a9e8-54eb53f78a05 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Getting quotas for user dd013ba83e944ecfa1a2d0a8a0d55101 and project b3171bab0ea547d9acc3559f449221eb. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:01:48.285737 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3022c063-f378-401d-a0fd-9a5c39fa19b8 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357" status: 200 len: 287 microversion: 2.1 time: 0.078562 Aug 29 19:01:48.286366 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 16/29] 10.222.0.86 () {58 vars in 1251 bytes} [Mon Aug 29 19:01:48 2022] GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:01:48.412700 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6f90d7ab-023a-4f7c-a9e8-54eb53f78a05 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.438667 Aug 29 19:01:48.413961 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 14/30] 10.222.0.86 () {62 vars in 1200 bytes} [Mon Aug 29 19:01:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 440 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:48.921784 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7a0d028b-276c-4e18-ae5a-53c011aa7310 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] Calling method '.version_select at 0x7fb2babffdc0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:49.001316 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-7a0d028b-276c-4e18-ae5a-53c011aa7310 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] HTTP exception thrown: Volume 8f8fd56a-1b1a-4bf7-8902-114bcc7db378 could not be found. Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7a0d028b-276c-4e18-ae5a-53c011aa7310 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] Request method failure captured: Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378 HTTP/1.1 Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0Pp-zF4iqLaHycUoYrOB0LHFM29CixXkbchEFxl6sMWqOsE1KSjxILuQsGsDeXOguNWi0faNsBNzOj8JVO_cJe67Zs40Oq3BXMD05-eiX26rosYJfBB4KDIMUk0zkal3HT8k0Uk2P4odB8XkgBsGCNSEGBXnGqwykTnecaqlBSd9k Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 4c10f21807bb4d53a03d1b3e11f365fe Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesGetTestJSON-873118118 Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:01:49.005268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:01:49.006588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4c10f21807bb4d53a03d1b3e11f365fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4c10f21807bb4d53a03d1b3e11f365fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/4c10f21807bb4d53a03d1b3e11f365fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_4c10f21807bb4d53a03d1b3e11f365fe"}]}] Aug 29 19:01:49.006588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesGetTestJSON-873118118 Aug 29 19:01:49.006588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 4c10f21807bb4d53a03d1b3e11f365fe Aug 29 19:01:49.006588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesGetTestJSON-873118118 Aug 29 19:01:49.006588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesGetTestJSON-873118118-project Aug 29 19:01:49.006588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:01:49.006588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:01:49.006588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: c7dd8b82a5284a9ea576a6ae27bc5664 Aug 29 19:01:49.006588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesGetTestJSON-873118118-project Aug 29 19:01:49.006588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: Aug 29 19:01:49.006588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Volume 8f8fd56a-1b1a-4bf7-8902-114bcc7db378 could not be found. Aug 29 19:01:49.006588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': '8f8fd56a-1b1a-4bf7-8902-114bcc7db378'} Aug 29 19:01:49.006588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f8fd56a-1b1a-4bf7-8902-114bcc7db378 could not be found. (HTTP 404) (Request-ID: req-0448ded4-e293-4f48-bb4d-a46732f81bea) Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:49.007503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:01:49.008507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f8fd56a-1b1a-4bf7-8902-114bcc7db378 could not be found. Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 19:01:49.009692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:01:49.010726 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f8fd56a-1b1a-4bf7-8902-114bcc7db378 could not be found. Aug 29 19:01:49.010726 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:49.010726 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:49.010726 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:49.010726 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:49.010726 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:49.010726 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:49.010726 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:01:49.010726 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:01:49.010726 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f8fd56a-1b1a-4bf7-8902-114bcc7db378 could not be found. Aug 29 19:01:49.010726 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:49.012427 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7a0d028b-276c-4e18-ae5a-53c011aa7310 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] Returning 404 to user: Volume 8f8fd56a-1b1a-4bf7-8902-114bcc7db378 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:01:49.013408 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7a0d028b-276c-4e18-ae5a-53c011aa7310 tempest-VolumesGetTestJSON-873118118 tempest-VolumesGetTestJSON-873118118-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378" status: 404 len: 109 microversion: 2.1 time: 0.096962 Aug 29 19:01:49.016743 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 15/31] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:48 2022] GET /compute/v2.1/os-volumes/8f8fd56a-1b1a-4bf7-8902-114bcc7db378 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:01:49.057616 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1163799941", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452", "networks": [{"uuid": "1bc16ff4-017e-4f2f-841e-c3aa8145a600"}]}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:49.298357 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d962b853-11ff-40cc-9f60-8d5bf006ab92 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bab9e280>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:49.350970 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-d962b853-11ff-40cc-9f60-8d5bf006ab92 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] HTTP exception thrown: Snapshot fb052ba8-f176-4ce1-9777-bbca92f31357 could not be found. Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d962b853-11ff-40cc-9f60-8d5bf006ab92 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Request method failure captured: Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357 HTTP/1.1 Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0NA6-X4j6ko-eocNmVDJkRAtg2ShF2w3XWhYwQj-2Jq3c6Fcf5HveBQKYS_fFN6Paxf7BlZNZNacSvkuY1Svba76OCUlfaNdPvUmeFsQwcbcx_yGrOdwSJiyVL4k27bh4p465LoMyCnGM5k9BL1v6n4P2vdTl9XSMMSEtTUg_NiPg Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 90b1cb2f10754e4d90caf3e3030c1eb4 Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-238324229 Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:01:49.353156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:01:49.354203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/90b1cb2f10754e4d90caf3e3030c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/90b1cb2f10754e4d90caf3e3030c1eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/90b1cb2f10754e4d90caf3e3030c1eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_90b1cb2f10754e4d90caf3e3030c1eb4"}]}] Aug 29 19:01:49.354203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesSnapshotsTestJSON-238324229 Aug 29 19:01:49.354203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 90b1cb2f10754e4d90caf3e3030c1eb4 Aug 29 19:01:49.354203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-238324229 Aug 29 19:01:49.354203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesSnapshotsTestJSON-238324229-project Aug 29 19:01:49.354203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:01:49.354203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:01:49.354203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: cfe7c4e4e56e44d0aa562be2195bfdec Aug 29 19:01:49.354203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesSnapshotsTestJSON-238324229-project Aug 29 19:01:49.354203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: Aug 29 19:01:49.354203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Snapshot fb052ba8-f176-4ce1-9777-bbca92f31357 could not be found. Aug 29 19:01:49.354203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': 'fb052ba8-f176-4ce1-9777-bbca92f31357'} Aug 29 19:01:49.354203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fb052ba8-f176-4ce1-9777-bbca92f31357 could not be found. (HTTP 404) (Request-ID: req-a4376b90-b44d-4e19-8d12-ac5c5008a585) Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:49.354868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:01:49.356100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fb052ba8-f176-4ce1-9777-bbca92f31357 could not be found. Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 19:01:49.357133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:01:49.358718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fb052ba8-f176-4ce1-9777-bbca92f31357 could not be found. Aug 29 19:01:49.358718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:49.358718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:49.358718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:49.358718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:49.358718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:49.358718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:49.358718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:01:49.358718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:01:49.358718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fb052ba8-f176-4ce1-9777-bbca92f31357 could not be found. Aug 29 19:01:49.358718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:49.358718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d962b853-11ff-40cc-9f60-8d5bf006ab92 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Returning 404 to user: Snapshot fb052ba8-f176-4ce1-9777-bbca92f31357 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:01:49.358718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d962b853-11ff-40cc-9f60-8d5bf006ab92 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357" status: 404 len: 111 microversion: 2.1 time: 0.060441 Aug 29 19:01:49.358718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 16/32] 10.222.0.86 () {58 vars in 1251 bytes} [Mon Aug 29 19:01:49 2022] GET /compute/v2.1/os-snapshots/fb052ba8-f176-4ce1-9777-bbca92f31357 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:01:49.389303 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cd95469b-165e-4256-a40d-6819757a3c8c tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2babb1ee0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:49.420935 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] validate_networks() for [('1bc16ff4-017e-4f2f-841e-c3aa8145a600', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:01:49.670050 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-cd95469b-165e-4256-a40d-6819757a3c8c tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819" status: 202 len: 0 microversion: 2.1 time: 0.304744 Aug 29 19:01:49.671201 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 17/33] 10.222.0.86 () {58 vars in 1248 bytes} [Mon Aug 29 19:01:49 2022] DELETE /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:01:49.680456 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b548c897-3872-4039-96dd-a3b06fe912e2 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bab9e310>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:49.781257 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b548c897-3872-4039-96dd-a3b06fe912e2 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819" status: 200 len: 344 microversion: 2.1 time: 0.104952 Aug 29 19:01:49.788500 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 18/34] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:49 2022] GET /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:01:50.796455 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b3cc4570-91dc-4316-956d-dbb033401a95 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bab2e1f0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:50.858648 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-b3cc4570-91dc-4316-956d-dbb033401a95 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] HTTP exception thrown: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b3cc4570-91dc-4316-956d-dbb033401a95 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Request method failure captured: Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 HTTP/1.1 Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0NA6-X4j6ko-eocNmVDJkRAtg2ShF2w3XWhYwQj-2Jq3c6Fcf5HveBQKYS_fFN6Paxf7BlZNZNacSvkuY1Svba76OCUlfaNdPvUmeFsQwcbcx_yGrOdwSJiyVL4k27bh4p465LoMyCnGM5k9BL1v6n4P2vdTl9XSMMSEtTUg_NiPg Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 90b1cb2f10754e4d90caf3e3030c1eb4 Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-238324229 Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:01:50.862042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:01:50.863339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/90b1cb2f10754e4d90caf3e3030c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/90b1cb2f10754e4d90caf3e3030c1eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/90b1cb2f10754e4d90caf3e3030c1eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_90b1cb2f10754e4d90caf3e3030c1eb4"}]}] Aug 29 19:01:50.863339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesSnapshotsTestJSON-238324229 Aug 29 19:01:50.863339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 90b1cb2f10754e4d90caf3e3030c1eb4 Aug 29 19:01:50.863339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-238324229 Aug 29 19:01:50.863339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesSnapshotsTestJSON-238324229-project Aug 29 19:01:50.863339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:01:50.863339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:01:50.863339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: cfe7c4e4e56e44d0aa562be2195bfdec Aug 29 19:01:50.863339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesSnapshotsTestJSON-238324229-project Aug 29 19:01:50.863339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: Aug 29 19:01:50.863339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. Aug 29 19:01:50.863339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': 'd0c4c130-9cfc-4ac6-b10d-34bb0c8d3819'} Aug 29 19:01:50.863339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. (HTTP 404) (Request-ID: req-f1bf4163-4926-4742-a838-61e0842ad633) Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:50.864118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:01:50.865709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 19:01:50.867819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:01:50.869579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. Aug 29 19:01:50.869579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:50.869579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:50.869579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:50.869579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:50.869579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:50.869579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:50.869579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:01:50.869579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:01:50.869579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. Aug 29 19:01:50.869579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:50.872362 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b3cc4570-91dc-4316-956d-dbb033401a95 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Returning 404 to user: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:01:50.873771 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b3cc4570-91dc-4316-956d-dbb033401a95 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819" status: 404 len: 109 microversion: 2.1 time: 0.081705 Aug 29 19:01:50.874849 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 19/35] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:50 2022] GET /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:01:50.892444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-291452ec-f419-4558-b6f0-042de7dc5867 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2bab9edc0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:50.944649 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-291452ec-f419-4558-b6f0-042de7dc5867 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] HTTP exception thrown: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-291452ec-f419-4558-b6f0-042de7dc5867 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Request method failure captured: Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: DELETE /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 HTTP/1.1 Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0NA6-X4j6ko-eocNmVDJkRAtg2ShF2w3XWhYwQj-2Jq3c6Fcf5HveBQKYS_fFN6Paxf7BlZNZNacSvkuY1Svba76OCUlfaNdPvUmeFsQwcbcx_yGrOdwSJiyVL4k27bh4p465LoMyCnGM5k9BL1v6n4P2vdTl9XSMMSEtTUg_NiPg Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 90b1cb2f10754e4d90caf3e3030c1eb4 Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-238324229 Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:01:50.948011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:01:50.949066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/90b1cb2f10754e4d90caf3e3030c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/90b1cb2f10754e4d90caf3e3030c1eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/90b1cb2f10754e4d90caf3e3030c1eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_90b1cb2f10754e4d90caf3e3030c1eb4"}]}] Aug 29 19:01:50.949066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesSnapshotsTestJSON-238324229 Aug 29 19:01:50.949066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 90b1cb2f10754e4d90caf3e3030c1eb4 Aug 29 19:01:50.949066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-238324229 Aug 29 19:01:50.949066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesSnapshotsTestJSON-238324229-project Aug 29 19:01:50.949066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:01:50.949066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:01:50.949066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: cfe7c4e4e56e44d0aa562be2195bfdec Aug 29 19:01:50.949066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesSnapshotsTestJSON-238324229-project Aug 29 19:01:50.949066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: Aug 29 19:01:50.949066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. Aug 29 19:01:50.949066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': 'd0c4c130-9cfc-4ac6-b10d-34bb0c8d3819'} Aug 29 19:01:50.949066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. (HTTP 404) (Request-ID: req-f93754f0-cf3b-400a-9815-447d8e0434be) Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:50.949756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:01:50.951383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 19:01:50.952353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:01:50.953340 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. Aug 29 19:01:50.953340 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:50.953340 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:50.953340 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:50.953340 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:50.953340 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:50.953340 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:50.953340 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:01:50.953340 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:01:50.953340 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. Aug 29 19:01:50.953340 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:50.953340 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-291452ec-f419-4558-b6f0-042de7dc5867 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Returning 404 to user: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:01:50.953340 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-291452ec-f419-4558-b6f0-042de7dc5867 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819" status: 404 len: 109 microversion: 2.1 time: 0.062890 Aug 29 19:01:50.953340 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 20/36] 10.222.0.86 () {58 vars in 1248 bytes} [Mon Aug 29 19:01:50 2022] DELETE /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:01:50.963708 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a5527fb8-12fd-4f03-83ac-397ff51d5540 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Calling method '.version_select at 0x7fb2babb1ee0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:51.052089 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-a5527fb8-12fd-4f03-83ac-397ff51d5540 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] HTTP exception thrown: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a5527fb8-12fd-4f03-83ac-397ff51d5540 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Request method failure captured: Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 HTTP/1.1 Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0NA6-X4j6ko-eocNmVDJkRAtg2ShF2w3XWhYwQj-2Jq3c6Fcf5HveBQKYS_fFN6Paxf7BlZNZNacSvkuY1Svba76OCUlfaNdPvUmeFsQwcbcx_yGrOdwSJiyVL4k27bh4p465LoMyCnGM5k9BL1v6n4P2vdTl9XSMMSEtTUg_NiPg Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 90b1cb2f10754e4d90caf3e3030c1eb4 Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-238324229 Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:01:51.054815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:01:51.056979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/90b1cb2f10754e4d90caf3e3030c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/90b1cb2f10754e4d90caf3e3030c1eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/90b1cb2f10754e4d90caf3e3030c1eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_90b1cb2f10754e4d90caf3e3030c1eb4"}]}] Aug 29 19:01:51.056979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesSnapshotsTestJSON-238324229 Aug 29 19:01:51.056979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 90b1cb2f10754e4d90caf3e3030c1eb4 Aug 29 19:01:51.056979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-238324229 Aug 29 19:01:51.056979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesSnapshotsTestJSON-238324229-project Aug 29 19:01:51.056979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:01:51.056979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:01:51.056979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: cfe7c4e4e56e44d0aa562be2195bfdec Aug 29 19:01:51.056979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesSnapshotsTestJSON-238324229-project Aug 29 19:01:51.056979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: Aug 29 19:01:51.056979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. Aug 29 19:01:51.056979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': 'd0c4c130-9cfc-4ac6-b10d-34bb0c8d3819'} Aug 29 19:01:51.056979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. (HTTP 404) (Request-ID: req-16f423f8-1cd1-4d46-981e-3ce1889c7ebe) Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:51.058483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:01:51.059463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 19:01:51.061261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:01:51.062142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. Aug 29 19:01:51.062142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:51.062142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:51.062142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:51.062142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:51.062142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:51.062142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:51.062142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:01:51.062142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:01:51.062142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. Aug 29 19:01:51.062142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:01:51.062142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a5527fb8-12fd-4f03-83ac-397ff51d5540 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] Returning 404 to user: Volume d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:01:51.062142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a5527fb8-12fd-4f03-83ac-397ff51d5540 tempest-VolumesSnapshotsTestJSON-238324229 tempest-VolumesSnapshotsTestJSON-238324229-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819" status: 404 len: 109 microversion: 2.1 time: 0.096560 Aug 29 19:01:51.062142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 21/37] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:01:50 2022] GET /compute/v2.1/os-volumes/d0c4c130-9cfc-4ac6-b10d-34bb0c8d3819 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:01:51.669983 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-99662df1-2d98-4c67-afc1-af2069da8cfb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Action: 'create', calling method: .version_select at 0x7fb2bab9e1f0>, body: {"keypair": {"name": "tempest-keypair-1705003565", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOi5mqXuNszm5lhVPFgyTnPtVPw23Xk7RUxkrIpaQ6Oz+6fDzGf4wBcvj9CunsTVw0Wyf32Vu0AlYzSepyOLmzW+ia1XRtj+OrT8aFFlO4KhgFxNZzTElqWqyEmdbrgQCg=="}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:51.772287 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-99662df1-2d98-4c67-afc1-af2069da8cfb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Getting quotas for project 12c146a9d54f4ed0a4e8a4a835d6367f. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:01:51.784108 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-99662df1-2d98-4c67-afc1-af2069da8cfb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Getting quotas for user b114570010d94eea955b7b3f1fa97c0a and project 12c146a9d54f4ed0a4e8a4a835d6367f. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:01:51.849170 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-99662df1-2d98-4c67-afc1-af2069da8cfb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.558479 Aug 29 19:01:51.857038 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 22/38] 10.222.0.86 () {60 vars in 1159 bytes} [Mon Aug 29 19:01:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:01:52.799460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:01:52.799966 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:01:52.800420 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:01:52.801028 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:01:52.801191 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:01:52.849393 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:01:52.849903 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:01:52.850333 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:01:52.851089 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:01:52.851711 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:01:52.852140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:01:52.941613 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Getting quotas for project 4c6272dcd88f47abb7a514070aaaccd3. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:01:52.955972 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Getting quotas for user 5598718e51df4a7c92ef828de3003dc7 and project 4c6272dcd88f47abb7a514070aaaccd3. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:01:52.977610 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:01:52.994706 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:01:53.212204 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dc61f183-1889-48b0-96e3-97439a80ad41 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.347032 Aug 29 19:01:53.212855 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 17/39] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:01:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 4348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 19:01:53.225265 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fc6c41d9-2af7-41b1-b8cc-0e24816512be tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:53.226745 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fc6c41d9-2af7-41b1-b8cc-0e24816512be tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:01:53.832110 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fc6c41d9-2af7-41b1-b8cc-0e24816512be tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:01:53.858558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fc6c41d9-2af7-41b1-b8cc-0e24816512be tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1215 microversion: 2.1 time: 0.637017 Aug 29 19:01:53.860336 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 23/40] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:01:53 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1215 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:01:54.881796 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a5bf0093-4202-464c-b210-7851c8a306b4 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:54.884039 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a5bf0093-4202-464c-b210-7851c8a306b4 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:01:55.348509 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1200212849", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:55.460928 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a5bf0093-4202-464c-b210-7851c8a306b4 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:01:55.492613 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] validate_networks() for [('64d4415d-fe7c-4b7e-99ee-4cb6a31bf961', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:01:55.503506 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a5bf0093-4202-464c-b210-7851c8a306b4 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1215 microversion: 2.1 time: 0.625714 Aug 29 19:01:55.506289 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 24/41] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:01:54 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1215 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:01:55.842010 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1549974795", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9c0caad-1415-4013-9010-645c48c43ada"}], "security_groups": [{"name": "tempest-securitygroup--1885775136"}], "key_name": "tempest-keypair-199651159", "user_data": "}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:56.286920 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] validate_networks() for [('a9c0caad-1415-4013-9010-645c48c43ada', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:01:57.206305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:01:57.206854 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:01:57.207239 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:01:57.207658 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:01:57.208073 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:01:57.224425 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:01:57.225098 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:01:57.227962 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:01:57.230189 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:01:57.232586 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:01:57.233308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:01:57.296906 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Getting quotas for project 4f32b60f5fa8427386bafa1a91f4e608. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:01:57.310709 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Getting quotas for user 962284e9a353430881bc119e5f80a890 and project 4f32b60f5fa8427386bafa1a91f4e608. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:01:57.349242 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:01:57.356726 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:01:57.500325 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f21c5c4f-f370-4cc0-a3e1-3b3884b045d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.874049 Aug 29 19:01:57.504825 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 18/42] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:01:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 2881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:01:57.514386 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-11c6616d-ed1c-402c-bcbc-eff7f8cfd883 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:57.517335 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-11c6616d-ed1c-402c-bcbc-eff7f8cfd883 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:01:57.570853 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11c6616d-ed1c-402c-bcbc-eff7f8cfd883 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:01:57.571606 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11c6616d-ed1c-402c-bcbc-eff7f8cfd883 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:01:57.572254 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11c6616d-ed1c-402c-bcbc-eff7f8cfd883 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:01:57.573117 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11c6616d-ed1c-402c-bcbc-eff7f8cfd883 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:01:57.574002 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11c6616d-ed1c-402c-bcbc-eff7f8cfd883 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:01:57.574721 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11c6616d-ed1c-402c-bcbc-eff7f8cfd883 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:01:58.190357 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-11c6616d-ed1c-402c-bcbc-eff7f8cfd883 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:01:58.230052 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-11c6616d-ed1c-402c-bcbc-eff7f8cfd883 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1273 microversion: 2.1 time: 0.723212 Aug 29 19:01:58.249456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 19/43] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:01:57 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1273 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:01:58.256733 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ecd0b2d0-9d42-49b3-9647-b9551e3a56cc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:58.257703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ecd0b2d0-9d42-49b3-9647-b9551e3a56cc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:01:58.476500 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ecd0b2d0-9d42-49b3-9647-b9551e3a56cc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:01:58.519067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ecd0b2d0-9d42-49b3-9647-b9551e3a56cc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1222 microversion: 2.1 time: 0.266628 Aug 29 19:01:58.527069 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 20/44] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:01:58 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1222 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:01:58.543109 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-805516430", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4796b378-18d8-4167-a54f-913080614900"}], "security_groups": [{"name": "tempest-securitygroup--1055209405"}], "key_name": "tempest-keypair-1705003565", "user_data": "}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:58.571360 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:01:58.571853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:01:58.572595 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:01:58.573074 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:01:58.573639 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:01:58.602649 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:01:58.605485 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:01:58.610611 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:01:58.612019 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:01:58.614233 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:01:58.616713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:01:58.744904 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Getting quotas for project b3171bab0ea547d9acc3559f449221eb. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:01:58.758039 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Getting quotas for user dd013ba83e944ecfa1a2d0a8a0d55101 and project b3171bab0ea547d9acc3559f449221eb. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:01:58.782843 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:01:58.792367 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:01:58.835473 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] validate_networks() for [('4796b378-18d8-4167-a54f-913080614900', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:01:58.956861 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-cf98e3a9-7dd9-4b7d-b673-689aeec1e51c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.123107 Aug 29 19:01:58.957500 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 25/45] 10.222.0.86 () {62 vars in 1188 bytes} [Mon Aug 29 19:01:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 3125 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 19:01:58.996572 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-379019022", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:59.225838 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] validate_networks() for [('64d4415d-fe7c-4b7e-99ee-4cb6a31bf961', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:02:01.832110 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:02:01.833489 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:02:01.834196 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:02:01.834887 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:02:01.835537 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:02:01.870528 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:01.871514 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:01.872251 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:01.873335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:01.877286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:01.878056 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:01.946328 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Getting quotas for project 4f32b60f5fa8427386bafa1a91f4e608. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:02:01.957074 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Getting quotas for user 962284e9a353430881bc119e5f80a890 and project 4f32b60f5fa8427386bafa1a91f4e608. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:02:01.988675 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:02:01.993081 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:02:02.166394 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2204e358-bf54-40aa-aa81-3fe85d9a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.205256 Aug 29 19:02:02.175478 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 26/46] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:01:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 3217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:02:02.198153 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-783757ab-b85d-4cc2-a6c7-80df8b651325 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:02.200485 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-783757ab-b85d-4cc2-a6c7-80df8b651325 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:02.259345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-783757ab-b85d-4cc2-a6c7-80df8b651325 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:02.259901 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-783757ab-b85d-4cc2-a6c7-80df8b651325 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:02.263413 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-783757ab-b85d-4cc2-a6c7-80df8b651325 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:02.267682 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-783757ab-b85d-4cc2-a6c7-80df8b651325 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:02.269872 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-783757ab-b85d-4cc2-a6c7-80df8b651325 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:02.272588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-783757ab-b85d-4cc2-a6c7-80df8b651325 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:02.277969 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:02:02.278672 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:02:02.279268 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:02:02.279742 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:02:02.280371 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:02:02.313817 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:02.318088 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:02.322863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:02.325191 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:02.333065 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:02.333641 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:02.435840 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Getting quotas for project 12c146a9d54f4ed0a4e8a4a835d6367f. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:02:02.455930 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Getting quotas for user b114570010d94eea955b7b3f1fa97c0a and project 12c146a9d54f4ed0a4e8a4a835d6367f. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:02:02.519118 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:02:02.550399 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:02:02.807880 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4c4fe2b3-99e7-46db-acf0-c1f1ec0b2a73 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.271667 Aug 29 19:02:02.808532 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 21/47] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:01:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 4280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:02:02.855681 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-74095b0d-4d71-4c2f-971d-de0e7b17a869 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:02.864838 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-74095b0d-4d71-4c2f-971d-de0e7b17a869 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:02.911893 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74095b0d-4d71-4c2f-971d-de0e7b17a869 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:02.916785 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74095b0d-4d71-4c2f-971d-de0e7b17a869 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:02.918084 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74095b0d-4d71-4c2f-971d-de0e7b17a869 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:02.925973 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74095b0d-4d71-4c2f-971d-de0e7b17a869 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:02.926480 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74095b0d-4d71-4c2f-971d-de0e7b17a869 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:02.931353 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74095b0d-4d71-4c2f-971d-de0e7b17a869 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:03.054917 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-783757ab-b85d-4cc2-a6c7-80df8b651325 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:03.134360 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-783757ab-b85d-4cc2-a6c7-80df8b651325 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:03.139305 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-783757ab-b85d-4cc2-a6c7-80df8b651325 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:03.159362 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-783757ab-b85d-4cc2-a6c7-80df8b651325 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1333 microversion: 2.20 time: 0.977666 Aug 29 19:02:03.162676 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 27/48] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:02 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1333 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:03.208045 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7a390058-084c-4dd1-bb2b-e7a913dfb0f2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:03.228771 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7a390058-084c-4dd1-bb2b-e7a913dfb0f2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:03.992291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7a390058-084c-4dd1-bb2b-e7a913dfb0f2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:04.002949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7a390058-084c-4dd1-bb2b-e7a913dfb0f2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1221 microversion: 2.1 time: 0.819197 Aug 29 19:02:04.005712 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 28/49] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:03 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1221 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:04.032281 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-27f1f13c-369b-4993-b49c-9f4ca4481153 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:04.034341 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-27f1f13c-369b-4993-b49c-9f4ca4481153 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:04.329628 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-27f1f13c-369b-4993-b49c-9f4ca4481153 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:04.366058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-27f1f13c-369b-4993-b49c-9f4ca4481153 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1237 microversion: 2.1 time: 0.358989 Aug 29 19:02:04.373182 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 29/50] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:04 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1237 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:04.386580 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-36b1d2ce-dd8a-45d4-93c7-6f2a94f8db58 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:04.393520 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-36b1d2ce-dd8a-45d4-93c7-6f2a94f8db58 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:04.410212 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36b1d2ce-dd8a-45d4-93c7-6f2a94f8db58 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:04.411276 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36b1d2ce-dd8a-45d4-93c7-6f2a94f8db58 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:04.414959 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36b1d2ce-dd8a-45d4-93c7-6f2a94f8db58 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:04.416646 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36b1d2ce-dd8a-45d4-93c7-6f2a94f8db58 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:04.422631 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36b1d2ce-dd8a-45d4-93c7-6f2a94f8db58 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:04.425072 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36b1d2ce-dd8a-45d4-93c7-6f2a94f8db58 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:05.553934 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-74095b0d-4d71-4c2f-971d-de0e7b17a869 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:05.570207 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-74095b0d-4d71-4c2f-971d-de0e7b17a869 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 2.752575 Aug 29 19:02:05.570798 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 22/51] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:02 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 2756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:05.575493 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6fea4343-d686-428b-ac97-14560de2230a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:05.576104 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6fea4343-d686-428b-ac97-14560de2230a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:05.596726 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6fea4343-d686-428b-ac97-14560de2230a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:05.598253 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6fea4343-d686-428b-ac97-14560de2230a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:05.599108 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6fea4343-d686-428b-ac97-14560de2230a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:05.600473 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6fea4343-d686-428b-ac97-14560de2230a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:05.619358 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6fea4343-d686-428b-ac97-14560de2230a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:05.620238 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6fea4343-d686-428b-ac97-14560de2230a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:05.645985 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-36b1d2ce-dd8a-45d4-93c7-6f2a94f8db58 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:05.663286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-36b1d2ce-dd8a-45d4-93c7-6f2a94f8db58 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:05.665045 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-36b1d2ce-dd8a-45d4-93c7-6f2a94f8db58 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:05.668558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-36b1d2ce-dd8a-45d4-93c7-6f2a94f8db58 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1339 microversion: 2.20 time: 1.293975 Aug 29 19:02:05.669531 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 30/52] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:04 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1339 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:05.694774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b6b441d4-f1cd-4473-ac4b-9ca3303a6551 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:05.699976 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b6b441d4-f1cd-4473-ac4b-9ca3303a6551 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:05.714231 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b6b441d4-f1cd-4473-ac4b-9ca3303a6551 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:05.720491 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b6b441d4-f1cd-4473-ac4b-9ca3303a6551 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:05.721209 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b6b441d4-f1cd-4473-ac4b-9ca3303a6551 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:05.722558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b6b441d4-f1cd-4473-ac4b-9ca3303a6551 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:05.723818 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b6b441d4-f1cd-4473-ac4b-9ca3303a6551 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:05.724853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b6b441d4-f1cd-4473-ac4b-9ca3303a6551 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:05.890747 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6fea4343-d686-428b-ac97-14560de2230a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:05.904283 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6fea4343-d686-428b-ac97-14560de2230a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1273 microversion: 2.1 time: 0.332334 Aug 29 19:02:05.907688 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 23/53] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:05 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1273 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:05.977582 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b6b441d4-f1cd-4473-ac4b-9ca3303a6551 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:05.985950 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b6b441d4-f1cd-4473-ac4b-9ca3303a6551 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1289 microversion: 2.1 time: 0.304632 Aug 29 19:02:05.986533 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 31/54] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:05 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1289 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:06.594026 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c9e27e91-dff6-4150-8215-2175fd1479a1 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:06.594663 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c9e27e91-dff6-4150-8215-2175fd1479a1 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:06.617141 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9e27e91-dff6-4150-8215-2175fd1479a1 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:06.617881 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9e27e91-dff6-4150-8215-2175fd1479a1 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:06.621801 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9e27e91-dff6-4150-8215-2175fd1479a1 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:06.622570 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9e27e91-dff6-4150-8215-2175fd1479a1 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:06.623074 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9e27e91-dff6-4150-8215-2175fd1479a1 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:06.623515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9e27e91-dff6-4150-8215-2175fd1479a1 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:06.698001 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a75bee6c-b5d9-4259-9e76-cdc71c054133 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:06.698638 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a75bee6c-b5d9-4259-9e76-cdc71c054133 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:06.712588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a75bee6c-b5d9-4259-9e76-cdc71c054133 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:06.713128 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a75bee6c-b5d9-4259-9e76-cdc71c054133 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:06.713570 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a75bee6c-b5d9-4259-9e76-cdc71c054133 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:06.717454 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a75bee6c-b5d9-4259-9e76-cdc71c054133 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:06.719337 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a75bee6c-b5d9-4259-9e76-cdc71c054133 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:06.722076 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a75bee6c-b5d9-4259-9e76-cdc71c054133 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:07.073430 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a75bee6c-b5d9-4259-9e76-cdc71c054133 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:07.096724 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a75bee6c-b5d9-4259-9e76-cdc71c054133 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:07.098259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a75bee6c-b5d9-4259-9e76-cdc71c054133 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:07.099454 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a75bee6c-b5d9-4259-9e76-cdc71c054133 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1339 microversion: 2.20 time: 0.406596 Aug 29 19:02:07.122666 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 32/55] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:06 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1339 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:07.139870 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6c727ad8-c0c0-4a03-b674-abc4ba4af693 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:07.141096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6c727ad8-c0c0-4a03-b674-abc4ba4af693 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:07.176196 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6c727ad8-c0c0-4a03-b674-abc4ba4af693 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:07.181734 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6c727ad8-c0c0-4a03-b674-abc4ba4af693 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:07.182412 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6c727ad8-c0c0-4a03-b674-abc4ba4af693 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:07.188327 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6c727ad8-c0c0-4a03-b674-abc4ba4af693 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:07.189025 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6c727ad8-c0c0-4a03-b674-abc4ba4af693 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:07.189666 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6c727ad8-c0c0-4a03-b674-abc4ba4af693 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:07.895610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6c727ad8-c0c0-4a03-b674-abc4ba4af693 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:07.907799 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6c727ad8-c0c0-4a03-b674-abc4ba4af693 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1291 microversion: 2.1 time: 0.783657 Aug 29 19:02:07.909096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 33/56] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:07 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1291 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:08.240479 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c9e27e91-dff6-4150-8215-2175fd1479a1 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:08.254000 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c9e27e91-dff6-4150-8215-2175fd1479a1 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 1.664823 Aug 29 19:02:08.257407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 24/57] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:06 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:08.272488 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dec27180-18e5-4740-8a54-9c12466c4f65 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:08.273410 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dec27180-18e5-4740-8a54-9c12466c4f65 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:08.286831 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dec27180-18e5-4740-8a54-9c12466c4f65 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:08.287689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dec27180-18e5-4740-8a54-9c12466c4f65 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:08.288373 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dec27180-18e5-4740-8a54-9c12466c4f65 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:08.289124 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dec27180-18e5-4740-8a54-9c12466c4f65 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:08.289575 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dec27180-18e5-4740-8a54-9c12466c4f65 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:08.289994 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dec27180-18e5-4740-8a54-9c12466c4f65 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:08.354987 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-711cf8ed-5faf-4135-8306-4736bb00750c req-a3eeb811-40da-430c-82ac-407f0d13511b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6d18f21-f26a-4726-bd5e-a4d06d2c21b6", "tag": "bb22b1e4-37ab-4211-b8c9-0eee1c7b0db7"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:02:08.388467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-711cf8ed-5faf-4135-8306-4736bb00750c req-a3eeb811-40da-430c-82ac-407f0d13511b service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:08.389997 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-711cf8ed-5faf-4135-8306-4736bb00750c req-a3eeb811-40da-430c-82ac-407f0d13511b service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:08.392649 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-711cf8ed-5faf-4135-8306-4736bb00750c req-a3eeb811-40da-430c-82ac-407f0d13511b service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:08.444363 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-711cf8ed-5faf-4135-8306-4736bb00750c req-a3eeb811-40da-430c-82ac-407f0d13511b service nova] Creating event network-changed:bb22b1e4-37ab-4211-b8c9-0eee1c7b0db7 for instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 on hv-cinder-85083 Aug 29 19:02:08.444920 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-711cf8ed-5faf-4135-8306-4736bb00750c req-a3eeb811-40da-430c-82ac-407f0d13511b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120708) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 19:02:08.445253 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-711cf8ed-5faf-4135-8306-4736bb00750c req-a3eeb811-40da-430c-82ac-407f0d13511b service nova] Acquired lock "compute-rpcapi-router" {{(pid=120708) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 19:02:08.446704 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5558d17-1309-46f9-bc5d-d0edf17c5a36 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:08.447344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5558d17-1309-46f9-bc5d-d0edf17c5a36 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:08.448070 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5558d17-1309-46f9-bc5d-d0edf17c5a36 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:08.451870 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5558d17-1309-46f9-bc5d-d0edf17c5a36 None None] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:08.455120 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5558d17-1309-46f9-bc5d-d0edf17c5a36 None None] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:08.455717 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5558d17-1309-46f9-bc5d-d0edf17c5a36 None None] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:08.485390 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.compute.rpcapi [None req-b5558d17-1309-46f9-bc5d-d0edf17c5a36 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 19:02:08.486355 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5558d17-1309-46f9-bc5d-d0edf17c5a36 None None] Releasing lock "compute-rpcapi-router" {{(pid=120708) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 19:02:08.521060 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b5558d17-1309-46f9-bc5d-d0edf17c5a36 None None] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.610496 Aug 29 19:02:08.521871 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 34/58] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:02:08.537741 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1bda6665-17ae-4234-90e1-6fc07f74842e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:08.546406 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1bda6665-17ae-4234-90e1-6fc07f74842e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:08.566133 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dec27180-18e5-4740-8a54-9c12466c4f65 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:08.583219 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dec27180-18e5-4740-8a54-9c12466c4f65 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1295 microversion: 2.1 time: 0.321571 Aug 29 19:02:08.585757 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1bda6665-17ae-4234-90e1-6fc07f74842e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:08.586388 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1bda6665-17ae-4234-90e1-6fc07f74842e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:08.586926 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1bda6665-17ae-4234-90e1-6fc07f74842e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:08.587758 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1bda6665-17ae-4234-90e1-6fc07f74842e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:08.588337 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1bda6665-17ae-4234-90e1-6fc07f74842e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:08.589234 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 25/59] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:08 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1295 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:08.590075 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1bda6665-17ae-4234-90e1-6fc07f74842e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:08.939054 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2ffbff6d-85f5-4d8d-bc1a-ff88fa18c9c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:08.940074 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2ffbff6d-85f5-4d8d-bc1a-ff88fa18c9c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:08.956996 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ffbff6d-85f5-4d8d-bc1a-ff88fa18c9c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:08.980268 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ffbff6d-85f5-4d8d-bc1a-ff88fa18c9c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:08.993918 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ffbff6d-85f5-4d8d-bc1a-ff88fa18c9c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:08.995196 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ffbff6d-85f5-4d8d-bc1a-ff88fa18c9c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:08.997782 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ffbff6d-85f5-4d8d-bc1a-ff88fa18c9c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:08.999706 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ffbff6d-85f5-4d8d-bc1a-ff88fa18c9c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:09.548520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2ffbff6d-85f5-4d8d-bc1a-ff88fa18c9c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:09.566307 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2ffbff6d-85f5-4d8d-bc1a-ff88fa18c9c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1279 microversion: 2.1 time: 0.639259 Aug 29 19:02:09.595169 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 26/60] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:08 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1279 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:09.613707 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cba66c67-9db3-4d5e-82af-49349358d6a9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:09.622133 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cba66c67-9db3-4d5e-82af-49349358d6a9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:09.647817 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cba66c67-9db3-4d5e-82af-49349358d6a9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:09.648393 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cba66c67-9db3-4d5e-82af-49349358d6a9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:09.655212 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cba66c67-9db3-4d5e-82af-49349358d6a9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:09.656620 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cba66c67-9db3-4d5e-82af-49349358d6a9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:09.657107 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cba66c67-9db3-4d5e-82af-49349358d6a9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:09.657546 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cba66c67-9db3-4d5e-82af-49349358d6a9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:09.679981 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1bda6665-17ae-4234-90e1-6fc07f74842e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:09.696110 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1bda6665-17ae-4234-90e1-6fc07f74842e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:09.705870 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1bda6665-17ae-4234-90e1-6fc07f74842e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:09.708227 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1bda6665-17ae-4234-90e1-6fc07f74842e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 1.181345 Aug 29 19:02:09.715130 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 35/61] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:08 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:09.730549 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0fa8000e-bf9c-4bd3-96a4-c6fb80e11857 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:09.738301 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0fa8000e-bf9c-4bd3-96a4-c6fb80e11857 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:09.756107 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0fa8000e-bf9c-4bd3-96a4-c6fb80e11857 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:09.759235 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0fa8000e-bf9c-4bd3-96a4-c6fb80e11857 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:09.763525 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0fa8000e-bf9c-4bd3-96a4-c6fb80e11857 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:09.766662 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0fa8000e-bf9c-4bd3-96a4-c6fb80e11857 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:09.767410 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0fa8000e-bf9c-4bd3-96a4-c6fb80e11857 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:09.778735 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0fa8000e-bf9c-4bd3-96a4-c6fb80e11857 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:10.194004 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0fa8000e-bf9c-4bd3-96a4-c6fb80e11857 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:10.224379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0fa8000e-bf9c-4bd3-96a4-c6fb80e11857 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1295 microversion: 2.1 time: 0.507530 Aug 29 19:02:10.224981 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 36/62] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:09 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1295 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:10.600005 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bb996dd6-0097-4a4f-bdea-2a76117c5185 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:10.600632 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bb996dd6-0097-4a4f-bdea-2a76117c5185 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:10.613328 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb996dd6-0097-4a4f-bdea-2a76117c5185 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:10.619439 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb996dd6-0097-4a4f-bdea-2a76117c5185 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:10.621498 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb996dd6-0097-4a4f-bdea-2a76117c5185 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:10.623789 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb996dd6-0097-4a4f-bdea-2a76117c5185 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:10.626004 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb996dd6-0097-4a4f-bdea-2a76117c5185 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:10.629352 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb996dd6-0097-4a4f-bdea-2a76117c5185 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:11.098046 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cba66c67-9db3-4d5e-82af-49349358d6a9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:11.115196 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cba66c67-9db3-4d5e-82af-49349358d6a9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 1.515847 Aug 29 19:02:11.119141 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 27/63] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:09 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:11.151877 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-02cc1869-c627-4706-becc-85692b3956f2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:11.155608 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-02cc1869-c627-4706-becc-85692b3956f2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:11.194931 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-02cc1869-c627-4706-becc-85692b3956f2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:11.195470 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-02cc1869-c627-4706-becc-85692b3956f2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:11.195920 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-02cc1869-c627-4706-becc-85692b3956f2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:11.196775 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-02cc1869-c627-4706-becc-85692b3956f2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:11.197242 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-02cc1869-c627-4706-becc-85692b3956f2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:11.197732 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-02cc1869-c627-4706-becc-85692b3956f2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:11.254497 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bb996dd6-0097-4a4f-bdea-2a76117c5185 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:11.273915 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bb996dd6-0097-4a4f-bdea-2a76117c5185 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1279 microversion: 2.1 time: 0.685834 Aug 29 19:02:11.285662 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 37/64] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:10 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1279 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:11.294981 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-644666fc-0d6f-4cf0-8615-c5f73c2942d1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:11.295633 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-644666fc-0d6f-4cf0-8615-c5f73c2942d1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:11.326848 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-644666fc-0d6f-4cf0-8615-c5f73c2942d1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:11.327381 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-644666fc-0d6f-4cf0-8615-c5f73c2942d1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:11.327865 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-644666fc-0d6f-4cf0-8615-c5f73c2942d1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:11.328571 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-644666fc-0d6f-4cf0-8615-c5f73c2942d1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:11.329027 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-644666fc-0d6f-4cf0-8615-c5f73c2942d1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:11.329450 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-644666fc-0d6f-4cf0-8615-c5f73c2942d1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:11.658802 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-644666fc-0d6f-4cf0-8615-c5f73c2942d1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:11.698693 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-644666fc-0d6f-4cf0-8615-c5f73c2942d1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1295 microversion: 2.1 time: 0.409697 Aug 29 19:02:11.711074 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 38/65] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:11 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1295 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:12.149977 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-256ccdd6-126b-4e96-b0c0-f4b06de65caa tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:12.150593 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-256ccdd6-126b-4e96-b0c0-f4b06de65caa tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:12.161228 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-256ccdd6-126b-4e96-b0c0-f4b06de65caa tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:12.161792 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-256ccdd6-126b-4e96-b0c0-f4b06de65caa tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:12.167505 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-256ccdd6-126b-4e96-b0c0-f4b06de65caa tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:12.168479 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-256ccdd6-126b-4e96-b0c0-f4b06de65caa tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:12.169089 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-256ccdd6-126b-4e96-b0c0-f4b06de65caa tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:12.169756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-256ccdd6-126b-4e96-b0c0-f4b06de65caa tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:12.343863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-02cc1869-c627-4706-becc-85692b3956f2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:12.357941 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-02cc1869-c627-4706-becc-85692b3956f2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:12.364089 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-02cc1869-c627-4706-becc-85692b3956f2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:12.366437 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-02cc1869-c627-4706-becc-85692b3956f2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 1.246121 Aug 29 19:02:12.372352 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 28/66] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:11 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:12.389294 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f251edfd-151e-4871-a053-12f169911d32 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:12.401151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f251edfd-151e-4871-a053-12f169911d32 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:12.405349 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=6 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:12.448918 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f251edfd-151e-4871-a053-12f169911d32 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:12.449880 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f251edfd-151e-4871-a053-12f169911d32 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:12.455315 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f251edfd-151e-4871-a053-12f169911d32 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:12.457403 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f251edfd-151e-4871-a053-12f169911d32 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:12.458226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f251edfd-151e-4871-a053-12f169911d32 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:12.462191 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f251edfd-151e-4871-a053-12f169911d32 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:12.502122 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=20 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:13.371679 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f251edfd-151e-4871-a053-12f169911d32 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:13.393268 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f251edfd-151e-4871-a053-12f169911d32 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1279 microversion: 2.1 time: 1.015058 Aug 29 19:02:13.414964 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 29/67] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:12 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1279 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:13.416976 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-23ccc5b3-17ce-4f02-818a-e5354197b97c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:13.417651 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-23ccc5b3-17ce-4f02-818a-e5354197b97c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:13.427254 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-23ccc5b3-17ce-4f02-818a-e5354197b97c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:13.428193 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-23ccc5b3-17ce-4f02-818a-e5354197b97c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:13.428886 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-23ccc5b3-17ce-4f02-818a-e5354197b97c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:13.429916 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-23ccc5b3-17ce-4f02-818a-e5354197b97c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:13.430738 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-23ccc5b3-17ce-4f02-818a-e5354197b97c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:13.431406 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-23ccc5b3-17ce-4f02-818a-e5354197b97c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:13.588561 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-256ccdd6-126b-4e96-b0c0-f4b06de65caa tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:13.612400 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-256ccdd6-126b-4e96-b0c0-f4b06de65caa tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 1.473520 Aug 29 19:02:13.615914 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 39/68] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:12 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:14.305683 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-897594cf-2eb5-4648-b218-5d25db3f44f0 req-c8387250-8cb2-4c83-9cee-bdc1021a139c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e88e76a-d978-4b39-89f0-d1dd5a154250", "tag": "9b7379ea-5177-4f98-8727-d75f6b260a12"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:02:14.336378 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-897594cf-2eb5-4648-b218-5d25db3f44f0 req-c8387250-8cb2-4c83-9cee-bdc1021a139c service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:14.337944 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-897594cf-2eb5-4648-b218-5d25db3f44f0 req-c8387250-8cb2-4c83-9cee-bdc1021a139c service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:14.339670 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-897594cf-2eb5-4648-b218-5d25db3f44f0 req-c8387250-8cb2-4c83-9cee-bdc1021a139c service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:14.376733 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=28 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:14.385242 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-897594cf-2eb5-4648-b218-5d25db3f44f0 req-c8387250-8cb2-4c83-9cee-bdc1021a139c service nova] Creating event network-changed:9b7379ea-5177-4f98-8727-d75f6b260a12 for instance 2e88e76a-d978-4b39-89f0-d1dd5a154250 on hv-cinder-85083 Aug 29 19:02:14.401752 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-897594cf-2eb5-4648-b218-5d25db3f44f0 req-c8387250-8cb2-4c83-9cee-bdc1021a139c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.783344 Aug 29 19:02:14.404605 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 40/69] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:02:14.430045 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2b04f1eb-bf23-42b6-855a-70a592af555f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:14.435265 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2b04f1eb-bf23-42b6-855a-70a592af555f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:14.448718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:14.461877 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b04f1eb-bf23-42b6-855a-70a592af555f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:14.462380 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b04f1eb-bf23-42b6-855a-70a592af555f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:14.467643 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b04f1eb-bf23-42b6-855a-70a592af555f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:14.469633 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b04f1eb-bf23-42b6-855a-70a592af555f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:14.470860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b04f1eb-bf23-42b6-855a-70a592af555f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:14.474391 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b04f1eb-bf23-42b6-855a-70a592af555f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:14.809273 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-23ccc5b3-17ce-4f02-818a-e5354197b97c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:14.819477 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-23ccc5b3-17ce-4f02-818a-e5354197b97c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 1.407792 Aug 29 19:02:14.825555 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 30/70] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:13 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:14.843696 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2b04f1eb-bf23-42b6-855a-70a592af555f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:14.844233 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0ce2b1bd-2cfd-4a06-a7d9-6692c95b5a8d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:14.845750 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0ce2b1bd-2cfd-4a06-a7d9-6692c95b5a8d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:14.853023 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2b04f1eb-bf23-42b6-855a-70a592af555f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:14.857593 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2b04f1eb-bf23-42b6-855a-70a592af555f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:14.859653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ce2b1bd-2cfd-4a06-a7d9-6692c95b5a8d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:14.860149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ce2b1bd-2cfd-4a06-a7d9-6692c95b5a8d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:14.860581 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ce2b1bd-2cfd-4a06-a7d9-6692c95b5a8d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:14.861279 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ce2b1bd-2cfd-4a06-a7d9-6692c95b5a8d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:14.861747 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ce2b1bd-2cfd-4a06-a7d9-6692c95b5a8d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:14.862030 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2b04f1eb-bf23-42b6-855a-70a592af555f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.450910 Aug 29 19:02:14.862234 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ce2b1bd-2cfd-4a06-a7d9-6692c95b5a8d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:14.865436 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 41/71] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:14 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:14.870220 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a61feb3a-c5cc-4728-ac1c-dbecf6071b8b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:14.872922 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a61feb3a-c5cc-4728-ac1c-dbecf6071b8b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:14.886504 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a61feb3a-c5cc-4728-ac1c-dbecf6071b8b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:14.893425 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a61feb3a-c5cc-4728-ac1c-dbecf6071b8b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:14.894108 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a61feb3a-c5cc-4728-ac1c-dbecf6071b8b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:14.895041 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a61feb3a-c5cc-4728-ac1c-dbecf6071b8b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:14.895664 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a61feb3a-c5cc-4728-ac1c-dbecf6071b8b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:14.896242 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a61feb3a-c5cc-4728-ac1c-dbecf6071b8b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:15.230874 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a61feb3a-c5cc-4728-ac1c-dbecf6071b8b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:15.243442 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a61feb3a-c5cc-4728-ac1c-dbecf6071b8b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.376725 Aug 29 19:02:15.244328 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 42/72] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:14 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:15.255656 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0ce2b1bd-2cfd-4a06-a7d9-6692c95b5a8d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:15.265298 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0ce2b1bd-2cfd-4a06-a7d9-6692c95b5a8d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.435838 Aug 29 19:02:15.265886 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 31/73] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:14 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:15.278487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-95d0b363-e021-4fbe-89fd-31b96a03ea26 req-d2018332-5f05-4264-b78c-8e05d7f27c59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55705ba3-2981-43e1-80e0-29995ee472a9", "tag": "e7223967-a4dc-4ee2-8b85-82a153b42231"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:02:15.283274 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-95d0b363-e021-4fbe-89fd-31b96a03ea26 req-d2018332-5f05-4264-b78c-8e05d7f27c59 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:15.283758 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-95d0b363-e021-4fbe-89fd-31b96a03ea26 req-d2018332-5f05-4264-b78c-8e05d7f27c59 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:15.284183 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-95d0b363-e021-4fbe-89fd-31b96a03ea26 req-d2018332-5f05-4264-b78c-8e05d7f27c59 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:15.303285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-95d0b363-e021-4fbe-89fd-31b96a03ea26 req-d2018332-5f05-4264-b78c-8e05d7f27c59 service nova] Creating event network-changed:e7223967-a4dc-4ee2-8b85-82a153b42231 for instance 55705ba3-2981-43e1-80e0-29995ee472a9 on hv-cinder-85083 Aug 29 19:02:15.319050 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-95d0b363-e021-4fbe-89fd-31b96a03ea26 req-d2018332-5f05-4264-b78c-8e05d7f27c59 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071921 Aug 29 19:02:15.319877 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 43/74] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:02:15.855348 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9e775635-5add-471b-80c3-b260c313c534 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:15.856844 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9e775635-5add-471b-80c3-b260c313c534 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:15.859279 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=9 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:15.864460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e775635-5add-471b-80c3-b260c313c534 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:15.865486 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e775635-5add-471b-80c3-b260c313c534 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:15.865858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e775635-5add-471b-80c3-b260c313c534 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:15.866723 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e775635-5add-471b-80c3-b260c313c534 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:15.867240 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e775635-5add-471b-80c3-b260c313c534 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:15.867665 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e775635-5add-471b-80c3-b260c313c534 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:15.872771 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=73 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:15.893536 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4dc94704-5477-41d8-b588-f5780254abfc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:15.895716 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4dc94704-5477-41d8-b588-f5780254abfc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:15.919392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4dc94704-5477-41d8-b588-f5780254abfc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:15.920120 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4dc94704-5477-41d8-b588-f5780254abfc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:15.920708 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4dc94704-5477-41d8-b588-f5780254abfc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:15.922174 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4dc94704-5477-41d8-b588-f5780254abfc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:15.922828 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4dc94704-5477-41d8-b588-f5780254abfc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:15.923458 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4dc94704-5477-41d8-b588-f5780254abfc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:16.080735 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9e775635-5add-471b-80c3-b260c313c534 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:16.093922 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9e775635-5add-471b-80c3-b260c313c534 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.242219 Aug 29 19:02:16.107645 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 32/75] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:15 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:16.108479 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4dc94704-5477-41d8-b588-f5780254abfc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:16.120163 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4dc94704-5477-41d8-b588-f5780254abfc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:16.121754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4dc94704-5477-41d8-b588-f5780254abfc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:16.123111 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4dc94704-5477-41d8-b588-f5780254abfc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.236031 Aug 29 19:02:16.123830 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 44/76] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:15 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:02:16.266699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1b0f1490-417a-4062-97ac-f0c835faab59 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:16.267368 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1b0f1490-417a-4062-97ac-f0c835faab59 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:16.273349 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b0f1490-417a-4062-97ac-f0c835faab59 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:16.273838 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b0f1490-417a-4062-97ac-f0c835faab59 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:16.274268 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b0f1490-417a-4062-97ac-f0c835faab59 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:16.274960 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b0f1490-417a-4062-97ac-f0c835faab59 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:16.275442 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b0f1490-417a-4062-97ac-f0c835faab59 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:16.275868 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b0f1490-417a-4062-97ac-f0c835faab59 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:16.286076 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7a1fe676-16aa-4db4-97a7-1e021221c482 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:16.286951 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7a1fe676-16aa-4db4-97a7-1e021221c482 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:16.296744 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7a1fe676-16aa-4db4-97a7-1e021221c482 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:16.297994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7a1fe676-16aa-4db4-97a7-1e021221c482 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:16.298603 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7a1fe676-16aa-4db4-97a7-1e021221c482 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:16.299622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7a1fe676-16aa-4db4-97a7-1e021221c482 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:16.300226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7a1fe676-16aa-4db4-97a7-1e021221c482 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:16.300646 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7a1fe676-16aa-4db4-97a7-1e021221c482 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:16.632919 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1b0f1490-417a-4062-97ac-f0c835faab59 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:16.644915 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1b0f1490-417a-4062-97ac-f0c835faab59 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.382539 Aug 29 19:02:16.647740 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 33/77] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:16 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:16.662650 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-26a828c7-e259-4523-a9f9-67d268509d7e req-da2c9a8f-3ee9-493b-8975-9fd63debcaca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4429ad44-4714-483b-b5b3-0091aabe6905", "tag": "cf8e3469-e506-47a4-b46f-3674e9c0abab"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:02:16.680605 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7a1fe676-16aa-4db4-97a7-1e021221c482 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:16.690218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7a1fe676-16aa-4db4-97a7-1e021221c482 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.407984 Aug 29 19:02:16.707154 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 45/78] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:16 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:16.709738 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-26a828c7-e259-4523-a9f9-67d268509d7e req-da2c9a8f-3ee9-493b-8975-9fd63debcaca service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:16.710282 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-26a828c7-e259-4523-a9f9-67d268509d7e req-da2c9a8f-3ee9-493b-8975-9fd63debcaca service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:16.710708 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-26a828c7-e259-4523-a9f9-67d268509d7e req-da2c9a8f-3ee9-493b-8975-9fd63debcaca service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:16.732184 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-26a828c7-e259-4523-a9f9-67d268509d7e req-da2c9a8f-3ee9-493b-8975-9fd63debcaca service nova] Creating event network-changed:cf8e3469-e506-47a4-b46f-3674e9c0abab for instance 4429ad44-4714-483b-b5b3-0091aabe6905 on hv-cinder-85083 Aug 29 19:02:16.732595 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-26a828c7-e259-4523-a9f9-67d268509d7e req-da2c9a8f-3ee9-493b-8975-9fd63debcaca service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120707) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 19:02:16.732989 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-26a828c7-e259-4523-a9f9-67d268509d7e req-da2c9a8f-3ee9-493b-8975-9fd63debcaca service nova] Acquired lock "compute-rpcapi-router" {{(pid=120707) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 19:02:16.734780 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0719952a-2509-4906-ba3f-dac8ffceed89 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:16.735463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0719952a-2509-4906-ba3f-dac8ffceed89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:16.736204 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0719952a-2509-4906-ba3f-dac8ffceed89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:16.737158 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0719952a-2509-4906-ba3f-dac8ffceed89 None None] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:16.737777 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0719952a-2509-4906-ba3f-dac8ffceed89 None None] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:16.738509 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0719952a-2509-4906-ba3f-dac8ffceed89 None None] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:16.751312 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.compute.rpcapi [None req-0719952a-2509-4906-ba3f-dac8ffceed89 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 19:02:16.752204 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0719952a-2509-4906-ba3f-dac8ffceed89 None None] Releasing lock "compute-rpcapi-router" {{(pid=120707) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 19:02:16.770018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0719952a-2509-4906-ba3f-dac8ffceed89 None None] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120731 Aug 29 19:02:16.770911 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 34/79] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:02:17.123493 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a6b2aa80-4fdd-4c7d-8d90-3ca06f4c0317 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:17.124197 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a6b2aa80-4fdd-4c7d-8d90-3ca06f4c0317 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:17.131452 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6b2aa80-4fdd-4c7d-8d90-3ca06f4c0317 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:17.131925 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6b2aa80-4fdd-4c7d-8d90-3ca06f4c0317 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:17.132368 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6b2aa80-4fdd-4c7d-8d90-3ca06f4c0317 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:17.133314 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6b2aa80-4fdd-4c7d-8d90-3ca06f4c0317 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:17.133717 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6b2aa80-4fdd-4c7d-8d90-3ca06f4c0317 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:17.134135 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6b2aa80-4fdd-4c7d-8d90-3ca06f4c0317 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:17.150679 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f27d3d07-e709-4264-87e7-d7e314ec9fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:17.151728 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f27d3d07-e709-4264-87e7-d7e314ec9fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:17.160875 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f27d3d07-e709-4264-87e7-d7e314ec9fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:17.161720 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f27d3d07-e709-4264-87e7-d7e314ec9fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:17.162263 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f27d3d07-e709-4264-87e7-d7e314ec9fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:17.163604 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f27d3d07-e709-4264-87e7-d7e314ec9fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:17.164262 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f27d3d07-e709-4264-87e7-d7e314ec9fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:17.165678 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f27d3d07-e709-4264-87e7-d7e314ec9fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:17.207521 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:17.663115 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a6b2aa80-4fdd-4c7d-8d90-3ca06f4c0317 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:17.675971 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a6b2aa80-4fdd-4c7d-8d90-3ca06f4c0317 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.563854 Aug 29 19:02:17.676824 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 46/80] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:17 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:17.689929 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-e2df59f6-9165-4b1a-9fd2-068d902965ab req-7c469144-5852-4298-9618-3d68dd186773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c01f30bf-2698-4cae-a884-141ce3b7862a", "tag": "44e52739-3f46-4693-a6b5-905096ce7217"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:02:17.693827 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-e2df59f6-9165-4b1a-9fd2-068d902965ab req-7c469144-5852-4298-9618-3d68dd186773 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:17.694384 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-e2df59f6-9165-4b1a-9fd2-068d902965ab req-7c469144-5852-4298-9618-3d68dd186773 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:17.694880 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-e2df59f6-9165-4b1a-9fd2-068d902965ab req-7c469144-5852-4298-9618-3d68dd186773 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:17.707083 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f27d3d07-e709-4264-87e7-d7e314ec9fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:17.714797 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-e2df59f6-9165-4b1a-9fd2-068d902965ab req-7c469144-5852-4298-9618-3d68dd186773 service nova] Creating event network-changed:44e52739-3f46-4693-a6b5-905096ce7217 for instance c01f30bf-2698-4cae-a884-141ce3b7862a on hv-cinder-85083 Aug 29 19:02:17.716071 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f27d3d07-e709-4264-87e7-d7e314ec9fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:17.719127 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f27d3d07-e709-4264-87e7-d7e314ec9fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:17.720626 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f27d3d07-e709-4264-87e7-d7e314ec9fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.577150 Aug 29 19:02:17.724401 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-e2df59f6-9165-4b1a-9fd2-068d902965ab req-7c469144-5852-4298-9618-3d68dd186773 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046300 Aug 29 19:02:17.725423 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 47/81] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:02:17.731611 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 35/82] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:17 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:02:17.732690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-652637ec-1114-404c-bade-f6576ac76ce8 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:17.734751 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-652637ec-1114-404c-bade-f6576ac76ce8 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:17.744513 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2f258be1-5101-4a9b-be5f-1dc1e2341607 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:17.748811 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2f258be1-5101-4a9b-be5f-1dc1e2341607 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:17.749200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-652637ec-1114-404c-bade-f6576ac76ce8 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:17.749701 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-652637ec-1114-404c-bade-f6576ac76ce8 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:17.750388 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-652637ec-1114-404c-bade-f6576ac76ce8 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:17.751404 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-652637ec-1114-404c-bade-f6576ac76ce8 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:17.752072 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-652637ec-1114-404c-bade-f6576ac76ce8 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:17.752562 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-652637ec-1114-404c-bade-f6576ac76ce8 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:17.758160 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f258be1-5101-4a9b-be5f-1dc1e2341607 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:17.759173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f258be1-5101-4a9b-be5f-1dc1e2341607 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:17.759847 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f258be1-5101-4a9b-be5f-1dc1e2341607 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:17.760757 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f258be1-5101-4a9b-be5f-1dc1e2341607 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:17.761395 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f258be1-5101-4a9b-be5f-1dc1e2341607 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:17.762089 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f258be1-5101-4a9b-be5f-1dc1e2341607 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:17.985597 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2f258be1-5101-4a9b-be5f-1dc1e2341607 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:17.994439 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2f258be1-5101-4a9b-be5f-1dc1e2341607 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.261535 Aug 29 19:02:17.995361 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 36/83] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:17 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:18.014438 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-652637ec-1114-404c-bade-f6576ac76ce8 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:18.023406 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-652637ec-1114-404c-bade-f6576ac76ce8 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.296609 Aug 29 19:02:18.024490 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 48/84] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:17 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:18.698439 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-19b7d807-a1a6-4c04-8d14-8df1a003db95 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:18.700259 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-19b7d807-a1a6-4c04-8d14-8df1a003db95 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:18.711190 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19b7d807-a1a6-4c04-8d14-8df1a003db95 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:18.712556 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19b7d807-a1a6-4c04-8d14-8df1a003db95 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:18.713014 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19b7d807-a1a6-4c04-8d14-8df1a003db95 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:18.713826 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19b7d807-a1a6-4c04-8d14-8df1a003db95 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:18.714331 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19b7d807-a1a6-4c04-8d14-8df1a003db95 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:18.714760 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19b7d807-a1a6-4c04-8d14-8df1a003db95 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:18.747056 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-02157254-52f5-4766-96bc-f3efb13d9ca3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:18.748291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-02157254-52f5-4766-96bc-f3efb13d9ca3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:18.751271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:18.759243 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-02157254-52f5-4766-96bc-f3efb13d9ca3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:18.760397 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-02157254-52f5-4766-96bc-f3efb13d9ca3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:18.761202 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-02157254-52f5-4766-96bc-f3efb13d9ca3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:18.762082 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-02157254-52f5-4766-96bc-f3efb13d9ca3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:18.762812 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-02157254-52f5-4766-96bc-f3efb13d9ca3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:18.763454 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-02157254-52f5-4766-96bc-f3efb13d9ca3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:18.943605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-19b7d807-a1a6-4c04-8d14-8df1a003db95 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:18.958800 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-19b7d807-a1a6-4c04-8d14-8df1a003db95 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.264445 Aug 29 19:02:18.960783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 37/85] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:18 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:18.974429 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-02157254-52f5-4766-96bc-f3efb13d9ca3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:18.984989 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-02157254-52f5-4766-96bc-f3efb13d9ca3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:18.986468 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-02157254-52f5-4766-96bc-f3efb13d9ca3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:18.988584 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-02157254-52f5-4766-96bc-f3efb13d9ca3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.248367 Aug 29 19:02:18.989604 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 49/86] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:18 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:19.015088 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c75db20c-c58a-4a26-9b11-f25796b05735 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:19.015853 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c75db20c-c58a-4a26-9b11-f25796b05735 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:19.022102 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c75db20c-c58a-4a26-9b11-f25796b05735 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:19.022601 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c75db20c-c58a-4a26-9b11-f25796b05735 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:19.023049 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c75db20c-c58a-4a26-9b11-f25796b05735 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:19.023744 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c75db20c-c58a-4a26-9b11-f25796b05735 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:19.024183 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c75db20c-c58a-4a26-9b11-f25796b05735 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:19.024771 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c75db20c-c58a-4a26-9b11-f25796b05735 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:19.045879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ddbac28d-dfd8-477a-9f71-6fbb6d12abf5 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:19.047371 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ddbac28d-dfd8-477a-9f71-6fbb6d12abf5 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:19.054130 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ddbac28d-dfd8-477a-9f71-6fbb6d12abf5 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:19.054675 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ddbac28d-dfd8-477a-9f71-6fbb6d12abf5 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:19.055553 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ddbac28d-dfd8-477a-9f71-6fbb6d12abf5 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:19.056522 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ddbac28d-dfd8-477a-9f71-6fbb6d12abf5 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:19.057187 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ddbac28d-dfd8-477a-9f71-6fbb6d12abf5 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:19.057857 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ddbac28d-dfd8-477a-9f71-6fbb6d12abf5 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:19.284848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c75db20c-c58a-4a26-9b11-f25796b05735 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:19.293399 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c75db20c-c58a-4a26-9b11-f25796b05735 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.282155 Aug 29 19:02:19.293987 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 38/87] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:19 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:19.327367 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ddbac28d-dfd8-477a-9f71-6fbb6d12abf5 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:19.335882 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ddbac28d-dfd8-477a-9f71-6fbb6d12abf5 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.294022 Aug 29 19:02:19.336513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 50/88] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:19 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:19.982890 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3271e7ef-1a98-46b6-9c90-f69e195662f0 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:19.982890 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3271e7ef-1a98-46b6-9c90-f69e195662f0 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:19.988550 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3271e7ef-1a98-46b6-9c90-f69e195662f0 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:19.989051 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3271e7ef-1a98-46b6-9c90-f69e195662f0 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:19.989487 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3271e7ef-1a98-46b6-9c90-f69e195662f0 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:19.990180 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3271e7ef-1a98-46b6-9c90-f69e195662f0 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:19.990638 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3271e7ef-1a98-46b6-9c90-f69e195662f0 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:19.991085 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3271e7ef-1a98-46b6-9c90-f69e195662f0 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:20.012960 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a6393b3b-0b45-4ced-87d5-228491996f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:20.014363 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a6393b3b-0b45-4ced-87d5-228491996f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:20.026215 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6393b3b-0b45-4ced-87d5-228491996f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:20.026632 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6393b3b-0b45-4ced-87d5-228491996f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:20.030163 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6393b3b-0b45-4ced-87d5-228491996f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:20.031664 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6393b3b-0b45-4ced-87d5-228491996f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:20.032477 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6393b3b-0b45-4ced-87d5-228491996f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:20.032980 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6393b3b-0b45-4ced-87d5-228491996f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:20.245390 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3271e7ef-1a98-46b6-9c90-f69e195662f0 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:20.260117 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a6393b3b-0b45-4ced-87d5-228491996f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:20.262245 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3271e7ef-1a98-46b6-9c90-f69e195662f0 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.285817 Aug 29 19:02:20.263305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 39/89] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:19 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:20.283100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a6393b3b-0b45-4ced-87d5-228491996f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:20.284546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a6393b3b-0b45-4ced-87d5-228491996f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:20.285674 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a6393b3b-0b45-4ced-87d5-228491996f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.277353 Aug 29 19:02:20.295330 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 51/90] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:20 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:02:20.314695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-115831fa-8b7a-4fc3-9680-eba841d88131 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:20.315364 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-115831fa-8b7a-4fc3-9680-eba841d88131 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:20.321866 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-115831fa-8b7a-4fc3-9680-eba841d88131 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:20.322553 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-115831fa-8b7a-4fc3-9680-eba841d88131 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:20.323205 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-115831fa-8b7a-4fc3-9680-eba841d88131 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:20.324071 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-115831fa-8b7a-4fc3-9680-eba841d88131 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:20.324520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-115831fa-8b7a-4fc3-9680-eba841d88131 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:20.325213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-115831fa-8b7a-4fc3-9680-eba841d88131 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:20.356329 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-13ca0f8d-13f7-44f6-97d5-388aa1b62e03 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:20.357014 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-13ca0f8d-13f7-44f6-97d5-388aa1b62e03 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:20.365082 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13ca0f8d-13f7-44f6-97d5-388aa1b62e03 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:20.366166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13ca0f8d-13f7-44f6-97d5-388aa1b62e03 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:20.367276 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13ca0f8d-13f7-44f6-97d5-388aa1b62e03 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:20.368260 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13ca0f8d-13f7-44f6-97d5-388aa1b62e03 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:20.368913 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13ca0f8d-13f7-44f6-97d5-388aa1b62e03 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:20.369779 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13ca0f8d-13f7-44f6-97d5-388aa1b62e03 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:20.531288 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-115831fa-8b7a-4fc3-9680-eba841d88131 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:20.539098 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-115831fa-8b7a-4fc3-9680-eba841d88131 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.228814 Aug 29 19:02:20.552223 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 40/91] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:20 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:20.612225 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-13ca0f8d-13f7-44f6-97d5-388aa1b62e03 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:20.622707 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-13ca0f8d-13f7-44f6-97d5-388aa1b62e03 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.269986 Aug 29 19:02:20.625060 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 52/92] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:20 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:21.284108 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d218cb10-6d8d-4d76-b592-225ef7e1b16b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:21.284716 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d218cb10-6d8d-4d76-b592-225ef7e1b16b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:21.290530 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d218cb10-6d8d-4d76-b592-225ef7e1b16b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:21.291225 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d218cb10-6d8d-4d76-b592-225ef7e1b16b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:21.291821 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d218cb10-6d8d-4d76-b592-225ef7e1b16b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:21.293028 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d218cb10-6d8d-4d76-b592-225ef7e1b16b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:21.294239 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d218cb10-6d8d-4d76-b592-225ef7e1b16b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:21.294672 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d218cb10-6d8d-4d76-b592-225ef7e1b16b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:21.309544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e55ca855-909c-41e6-acce-7139b022171d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:21.312045 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e55ca855-909c-41e6-acce-7139b022171d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:21.319700 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e55ca855-909c-41e6-acce-7139b022171d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:21.320408 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e55ca855-909c-41e6-acce-7139b022171d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:21.321059 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e55ca855-909c-41e6-acce-7139b022171d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:21.322039 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e55ca855-909c-41e6-acce-7139b022171d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:21.322638 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e55ca855-909c-41e6-acce-7139b022171d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:21.323283 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e55ca855-909c-41e6-acce-7139b022171d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:21.488219 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d218cb10-6d8d-4d76-b592-225ef7e1b16b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:21.496016 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d218cb10-6d8d-4d76-b592-225ef7e1b16b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.215990 Aug 29 19:02:21.497014 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 41/93] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:21 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:21.534935 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e55ca855-909c-41e6-acce-7139b022171d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:21.543966 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e55ca855-909c-41e6-acce-7139b022171d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:21.545686 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e55ca855-909c-41e6-acce-7139b022171d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:21.547017 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e55ca855-909c-41e6-acce-7139b022171d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.241806 Aug 29 19:02:21.547588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 53/94] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:21 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:02:21.563589 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-db66371c-b67d-4eb5-8a52-b352c10824d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:21.564632 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-db66371c-b67d-4eb5-8a52-b352c10824d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:21.572893 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db66371c-b67d-4eb5-8a52-b352c10824d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:21.573462 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db66371c-b67d-4eb5-8a52-b352c10824d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:21.573917 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db66371c-b67d-4eb5-8a52-b352c10824d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:21.574726 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db66371c-b67d-4eb5-8a52-b352c10824d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:21.575230 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db66371c-b67d-4eb5-8a52-b352c10824d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:21.575652 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db66371c-b67d-4eb5-8a52-b352c10824d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:21.645996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-892b8d2a-7261-47df-9d4c-c4d26afd870e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:21.646912 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-892b8d2a-7261-47df-9d4c-c4d26afd870e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:21.654212 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-892b8d2a-7261-47df-9d4c-c4d26afd870e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:21.654707 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-892b8d2a-7261-47df-9d4c-c4d26afd870e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:21.655730 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-892b8d2a-7261-47df-9d4c-c4d26afd870e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:21.657190 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-892b8d2a-7261-47df-9d4c-c4d26afd870e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:21.659051 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-892b8d2a-7261-47df-9d4c-c4d26afd870e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:21.659862 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-892b8d2a-7261-47df-9d4c-c4d26afd870e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:21.760658 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-db66371c-b67d-4eb5-8a52-b352c10824d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:21.774124 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-db66371c-b67d-4eb5-8a52-b352c10824d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.218238 Aug 29 19:02:21.776978 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 42/95] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:21 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:21.881249 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-892b8d2a-7261-47df-9d4c-c4d26afd870e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:21.892417 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-892b8d2a-7261-47df-9d4c-c4d26afd870e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.251179 Aug 29 19:02:21.897006 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 54/96] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:21 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:22.518804 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5ab6c8cd-feb7-46c0-9e12-ee32526f06dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:22.519572 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5ab6c8cd-feb7-46c0-9e12-ee32526f06dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:22.525523 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ab6c8cd-feb7-46c0-9e12-ee32526f06dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:22.526003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ab6c8cd-feb7-46c0-9e12-ee32526f06dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:22.526437 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ab6c8cd-feb7-46c0-9e12-ee32526f06dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:22.527179 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ab6c8cd-feb7-46c0-9e12-ee32526f06dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:22.527751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ab6c8cd-feb7-46c0-9e12-ee32526f06dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:22.528177 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ab6c8cd-feb7-46c0-9e12-ee32526f06dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:22.571584 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-dc5576bb-dbcf-407f-980c-7e23cff0627b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:22.572261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-dc5576bb-dbcf-407f-980c-7e23cff0627b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:22.580303 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc5576bb-dbcf-407f-980c-7e23cff0627b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:22.580804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc5576bb-dbcf-407f-980c-7e23cff0627b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:22.581374 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc5576bb-dbcf-407f-980c-7e23cff0627b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:22.582082 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc5576bb-dbcf-407f-980c-7e23cff0627b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:22.582739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc5576bb-dbcf-407f-980c-7e23cff0627b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:22.583210 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc5576bb-dbcf-407f-980c-7e23cff0627b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:22.720539 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5ab6c8cd-feb7-46c0-9e12-ee32526f06dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:22.728861 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5ab6c8cd-feb7-46c0-9e12-ee32526f06dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.214538 Aug 29 19:02:22.729437 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 43/97] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:22 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:22.770248 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-dc5576bb-dbcf-407f-980c-7e23cff0627b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:22.778615 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-dc5576bb-dbcf-407f-980c-7e23cff0627b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:22.780068 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-dc5576bb-dbcf-407f-980c-7e23cff0627b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:22.781254 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-dc5576bb-dbcf-407f-980c-7e23cff0627b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.215301 Aug 29 19:02:22.781796 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 55/98] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:22 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:02:22.800192 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-de07510c-e2ea-4780-bef3-83a0d604cae6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:22.800731 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-de07510c-e2ea-4780-bef3-83a0d604cae6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:22.806772 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de07510c-e2ea-4780-bef3-83a0d604cae6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:22.807288 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de07510c-e2ea-4780-bef3-83a0d604cae6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:22.807851 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de07510c-e2ea-4780-bef3-83a0d604cae6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:22.808562 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de07510c-e2ea-4780-bef3-83a0d604cae6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:22.809011 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de07510c-e2ea-4780-bef3-83a0d604cae6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:22.809429 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de07510c-e2ea-4780-bef3-83a0d604cae6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:22.917252 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-32a0d924-1f9e-4994-9a05-3600356f4cf7 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:22.917863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-32a0d924-1f9e-4994-9a05-3600356f4cf7 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:22.927950 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32a0d924-1f9e-4994-9a05-3600356f4cf7 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:22.929046 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32a0d924-1f9e-4994-9a05-3600356f4cf7 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:22.929509 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32a0d924-1f9e-4994-9a05-3600356f4cf7 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:22.930247 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32a0d924-1f9e-4994-9a05-3600356f4cf7 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:22.930696 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32a0d924-1f9e-4994-9a05-3600356f4cf7 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:22.934748 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32a0d924-1f9e-4994-9a05-3600356f4cf7 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:22.966371 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-de07510c-e2ea-4780-bef3-83a0d604cae6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:22.976303 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-de07510c-e2ea-4780-bef3-83a0d604cae6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.179995 Aug 29 19:02:22.977481 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 44/99] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:22 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:23.092565 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-32a0d924-1f9e-4994-9a05-3600356f4cf7 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:23.102960 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-32a0d924-1f9e-4994-9a05-3600356f4cf7 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.189989 Aug 29 19:02:23.103686 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 56/100] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:22 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:23.750179 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-acaf360c-a542-4898-be18-2fc030bdac27 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:23.751433 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-acaf360c-a542-4898-be18-2fc030bdac27 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:23.757411 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-acaf360c-a542-4898-be18-2fc030bdac27 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:23.757897 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-acaf360c-a542-4898-be18-2fc030bdac27 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:23.758334 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-acaf360c-a542-4898-be18-2fc030bdac27 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:23.759049 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-acaf360c-a542-4898-be18-2fc030bdac27 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:23.759493 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-acaf360c-a542-4898-be18-2fc030bdac27 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:23.759917 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-acaf360c-a542-4898-be18-2fc030bdac27 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:23.803830 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bce129a0-6f50-412c-9d3d-e6001f2fb1ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:23.805293 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bce129a0-6f50-412c-9d3d-e6001f2fb1ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:23.813093 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bce129a0-6f50-412c-9d3d-e6001f2fb1ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:23.813593 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bce129a0-6f50-412c-9d3d-e6001f2fb1ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:23.814033 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bce129a0-6f50-412c-9d3d-e6001f2fb1ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:23.814736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bce129a0-6f50-412c-9d3d-e6001f2fb1ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:23.815224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bce129a0-6f50-412c-9d3d-e6001f2fb1ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:23.815649 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bce129a0-6f50-412c-9d3d-e6001f2fb1ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:23.955210 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-acaf360c-a542-4898-be18-2fc030bdac27 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:23.966329 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-acaf360c-a542-4898-be18-2fc030bdac27 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.220198 Aug 29 19:02:23.966916 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 45/101] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:23 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:23.996580 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-98244d30-7676-430a-b896-203bb636cf4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:23.998312 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-98244d30-7676-430a-b896-203bb636cf4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:24.028024 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98244d30-7676-430a-b896-203bb636cf4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:24.029347 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98244d30-7676-430a-b896-203bb636cf4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:24.032524 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98244d30-7676-430a-b896-203bb636cf4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:24.033582 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98244d30-7676-430a-b896-203bb636cf4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:24.036674 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98244d30-7676-430a-b896-203bb636cf4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:24.037347 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98244d30-7676-430a-b896-203bb636cf4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:24.148738 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bce129a0-6f50-412c-9d3d-e6001f2fb1ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:24.160599 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bce129a0-6f50-412c-9d3d-e6001f2fb1ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:24.163309 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bce129a0-6f50-412c-9d3d-e6001f2fb1ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:24.168893 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bce129a0-6f50-412c-9d3d-e6001f2fb1ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.369056 Aug 29 19:02:24.183148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 57/102] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:23 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:02:24.183148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a4924e8d-ce91-45a1-aaac-d71b45f5d511 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:24.183148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a4924e8d-ce91-45a1-aaac-d71b45f5d511 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:24.213603 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4924e8d-ce91-45a1-aaac-d71b45f5d511 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:24.214106 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4924e8d-ce91-45a1-aaac-d71b45f5d511 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:24.214544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4924e8d-ce91-45a1-aaac-d71b45f5d511 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:24.228636 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4924e8d-ce91-45a1-aaac-d71b45f5d511 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:24.231406 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4924e8d-ce91-45a1-aaac-d71b45f5d511 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:24.233132 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4924e8d-ce91-45a1-aaac-d71b45f5d511 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:24.451148 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-98244d30-7676-430a-b896-203bb636cf4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:24.462143 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-98244d30-7676-430a-b896-203bb636cf4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.469259 Aug 29 19:02:24.462738 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 46/103] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:23 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:24.526631 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a4924e8d-ce91-45a1-aaac-d71b45f5d511 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:24.536435 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a4924e8d-ce91-45a1-aaac-d71b45f5d511 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.363002 Aug 29 19:02:24.539398 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 58/104] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:24 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:24.990771 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8f108547-9ea6-48e3-af8a-5c7262517d83 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:24.991411 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8f108547-9ea6-48e3-af8a-5c7262517d83 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:24.997279 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f108547-9ea6-48e3-af8a-5c7262517d83 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:24.997753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f108547-9ea6-48e3-af8a-5c7262517d83 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:24.998179 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f108547-9ea6-48e3-af8a-5c7262517d83 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:24.998865 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f108547-9ea6-48e3-af8a-5c7262517d83 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:24.999838 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f108547-9ea6-48e3-af8a-5c7262517d83 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:25.000255 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f108547-9ea6-48e3-af8a-5c7262517d83 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:25.128911 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8f108547-9ea6-48e3-af8a-5c7262517d83 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:25.136918 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8f108547-9ea6-48e3-af8a-5c7262517d83 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.149891 Aug 29 19:02:25.137589 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 47/105] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:24 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:25.193474 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-88e0e231-a0a9-408e-a15f-f8797e757c1e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:25.194074 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-88e0e231-a0a9-408e-a15f-f8797e757c1e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:25.200109 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88e0e231-a0a9-408e-a15f-f8797e757c1e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:25.200590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88e0e231-a0a9-408e-a15f-f8797e757c1e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:25.201149 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88e0e231-a0a9-408e-a15f-f8797e757c1e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:25.201831 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88e0e231-a0a9-408e-a15f-f8797e757c1e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:25.202843 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88e0e231-a0a9-408e-a15f-f8797e757c1e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:25.203464 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88e0e231-a0a9-408e-a15f-f8797e757c1e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:25.341811 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-88e0e231-a0a9-408e-a15f-f8797e757c1e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:25.350434 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-88e0e231-a0a9-408e-a15f-f8797e757c1e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:25.351884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-88e0e231-a0a9-408e-a15f-f8797e757c1e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:25.352967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-88e0e231-a0a9-408e-a15f-f8797e757c1e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.163742 Aug 29 19:02:25.353519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 59/106] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:25 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:25.488429 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bcbfb491-c687-482a-8d82-a2d9135d8f39 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:25.488952 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bcbfb491-c687-482a-8d82-a2d9135d8f39 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:25.495063 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bcbfb491-c687-482a-8d82-a2d9135d8f39 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:25.495567 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bcbfb491-c687-482a-8d82-a2d9135d8f39 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:25.495998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bcbfb491-c687-482a-8d82-a2d9135d8f39 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:25.496694 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bcbfb491-c687-482a-8d82-a2d9135d8f39 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:25.497138 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bcbfb491-c687-482a-8d82-a2d9135d8f39 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:25.497558 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bcbfb491-c687-482a-8d82-a2d9135d8f39 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:25.559558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fe4d8321-3d72-4d01-bff2-917002d7f5ec tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:25.560166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fe4d8321-3d72-4d01-bff2-917002d7f5ec tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:25.566595 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe4d8321-3d72-4d01-bff2-917002d7f5ec tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:25.567117 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe4d8321-3d72-4d01-bff2-917002d7f5ec tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:25.567807 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe4d8321-3d72-4d01-bff2-917002d7f5ec tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:25.568535 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe4d8321-3d72-4d01-bff2-917002d7f5ec tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:25.568987 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe4d8321-3d72-4d01-bff2-917002d7f5ec tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:25.569410 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe4d8321-3d72-4d01-bff2-917002d7f5ec tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:25.675893 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bcbfb491-c687-482a-8d82-a2d9135d8f39 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:25.690620 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bcbfb491-c687-482a-8d82-a2d9135d8f39 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.205989 Aug 29 19:02:25.693863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 48/107] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:25 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:25.726133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fe4d8321-3d72-4d01-bff2-917002d7f5ec tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:25.734365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fe4d8321-3d72-4d01-bff2-917002d7f5ec tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.178591 Aug 29 19:02:25.734940 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 60/108] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:25 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:26.137043 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-60375abc-889b-4128-a41c-7c04f309f3dd req-25088f17-67d7-4c19-a016-c66ca8c1cc4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d18f21-f26a-4726-bd5e-a4d06d2c21b6", "name": "network-vif-plugged", "status": "completed", "tag": "bb22b1e4-37ab-4211-b8c9-0eee1c7b0db7"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:02:26.147015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-60375abc-889b-4128-a41c-7c04f309f3dd req-25088f17-67d7-4c19-a016-c66ca8c1cc4d service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:26.147507 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-60375abc-889b-4128-a41c-7c04f309f3dd req-25088f17-67d7-4c19-a016-c66ca8c1cc4d service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:26.147937 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-60375abc-889b-4128-a41c-7c04f309f3dd req-25088f17-67d7-4c19-a016-c66ca8c1cc4d service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:26.151019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:26.158850 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9097c2e3-7890-45a0-ae73-3b7db21c570a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:26.159499 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9097c2e3-7890-45a0-ae73-3b7db21c570a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:26.166966 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9097c2e3-7890-45a0-ae73-3b7db21c570a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:26.167949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9097c2e3-7890-45a0-ae73-3b7db21c570a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:26.168538 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9097c2e3-7890-45a0-ae73-3b7db21c570a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:26.169331 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9097c2e3-7890-45a0-ae73-3b7db21c570a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:26.169983 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9097c2e3-7890-45a0-ae73-3b7db21c570a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:26.170242 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-60375abc-889b-4128-a41c-7c04f309f3dd req-25088f17-67d7-4c19-a016-c66ca8c1cc4d service nova] Creating event network-vif-plugged:bb22b1e4-37ab-4211-b8c9-0eee1c7b0db7 for instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 on hv-cinder-85083 Aug 29 19:02:26.171021 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9097c2e3-7890-45a0-ae73-3b7db21c570a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:26.176069 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-60375abc-889b-4128-a41c-7c04f309f3dd req-25088f17-67d7-4c19-a016-c66ca8c1cc4d service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107337 Aug 29 19:02:26.176723 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 49/109] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:02:26.313739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9097c2e3-7890-45a0-ae73-3b7db21c570a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:26.321827 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9097c2e3-7890-45a0-ae73-3b7db21c570a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.167757 Aug 29 19:02:26.322395 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 61/110] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:26 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:26.375580 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dc8b5203-57f3-4998-bfec-6681fa93be68 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:26.376270 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dc8b5203-57f3-4998-bfec-6681fa93be68 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:26.382342 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc8b5203-57f3-4998-bfec-6681fa93be68 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:26.382820 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc8b5203-57f3-4998-bfec-6681fa93be68 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:26.383278 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc8b5203-57f3-4998-bfec-6681fa93be68 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:26.383955 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc8b5203-57f3-4998-bfec-6681fa93be68 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:26.384550 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc8b5203-57f3-4998-bfec-6681fa93be68 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:26.384880 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc8b5203-57f3-4998-bfec-6681fa93be68 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:26.511862 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dc8b5203-57f3-4998-bfec-6681fa93be68 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:26.520335 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dc8b5203-57f3-4998-bfec-6681fa93be68 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:26.521761 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dc8b5203-57f3-4998-bfec-6681fa93be68 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:26.522843 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dc8b5203-57f3-4998-bfec-6681fa93be68 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.151681 Aug 29 19:02:26.523421 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 50/111] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:26 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:26.713469 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d77c3716-17b4-4152-978c-aa6de0010b23 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:26.714080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d77c3716-17b4-4152-978c-aa6de0010b23 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:26.720140 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d77c3716-17b4-4152-978c-aa6de0010b23 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:26.720617 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d77c3716-17b4-4152-978c-aa6de0010b23 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:26.721054 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d77c3716-17b4-4152-978c-aa6de0010b23 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:26.721730 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d77c3716-17b4-4152-978c-aa6de0010b23 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:26.722179 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d77c3716-17b4-4152-978c-aa6de0010b23 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:26.722605 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d77c3716-17b4-4152-978c-aa6de0010b23 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:26.755218 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-464c7387-27fb-4a61-a91d-decf06d7d611 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:26.755923 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-464c7387-27fb-4a61-a91d-decf06d7d611 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:26.758028 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:26.764195 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-464c7387-27fb-4a61-a91d-decf06d7d611 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:26.765354 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-464c7387-27fb-4a61-a91d-decf06d7d611 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:26.765884 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-464c7387-27fb-4a61-a91d-decf06d7d611 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:26.766652 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-464c7387-27fb-4a61-a91d-decf06d7d611 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:26.767220 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-464c7387-27fb-4a61-a91d-decf06d7d611 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:26.767647 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-464c7387-27fb-4a61-a91d-decf06d7d611 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:26.898713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d77c3716-17b4-4152-978c-aa6de0010b23 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:26.907865 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d77c3716-17b4-4152-978c-aa6de0010b23 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.197801 Aug 29 19:02:26.908922 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 62/112] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:26 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:26.927170 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-464c7387-27fb-4a61-a91d-decf06d7d611 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:26.935130 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-464c7387-27fb-4a61-a91d-decf06d7d611 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.183709 Aug 29 19:02:26.935698 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 51/113] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:26 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:27.342031 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d4ef0d12-0b02-43dc-9126-211d08ee17dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:27.343152 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d4ef0d12-0b02-43dc-9126-211d08ee17dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:27.349343 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4ef0d12-0b02-43dc-9126-211d08ee17dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:27.349827 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4ef0d12-0b02-43dc-9126-211d08ee17dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:27.350259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4ef0d12-0b02-43dc-9126-211d08ee17dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:27.350948 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4ef0d12-0b02-43dc-9126-211d08ee17dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:27.351418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4ef0d12-0b02-43dc-9126-211d08ee17dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:27.351839 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4ef0d12-0b02-43dc-9126-211d08ee17dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:27.484467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d4ef0d12-0b02-43dc-9126-211d08ee17dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:27.487826 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:27.492664 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d4ef0d12-0b02-43dc-9126-211d08ee17dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.154492 Aug 29 19:02:27.493224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 63/114] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:27 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:27.543872 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6523a256-41a0-4dc6-a0c1-96bb69189aa0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:27.544472 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6523a256-41a0-4dc6-a0c1-96bb69189aa0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:27.550962 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6523a256-41a0-4dc6-a0c1-96bb69189aa0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:27.551462 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6523a256-41a0-4dc6-a0c1-96bb69189aa0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:27.551883 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6523a256-41a0-4dc6-a0c1-96bb69189aa0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:27.552554 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6523a256-41a0-4dc6-a0c1-96bb69189aa0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:27.552993 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6523a256-41a0-4dc6-a0c1-96bb69189aa0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:27.553405 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6523a256-41a0-4dc6-a0c1-96bb69189aa0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:27.689112 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6523a256-41a0-4dc6-a0c1-96bb69189aa0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:27.698975 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6523a256-41a0-4dc6-a0c1-96bb69189aa0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:27.700475 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6523a256-41a0-4dc6-a0c1-96bb69189aa0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:27.701573 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6523a256-41a0-4dc6-a0c1-96bb69189aa0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.161514 Aug 29 19:02:27.702657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 52/115] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:27 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:27.928841 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4d1242aa-573e-4eca-b61f-f9bf6e68de72 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:27.929364 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4d1242aa-573e-4eca-b61f-f9bf6e68de72 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:27.935410 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d1242aa-573e-4eca-b61f-f9bf6e68de72 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:27.935884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d1242aa-573e-4eca-b61f-f9bf6e68de72 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:27.936311 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d1242aa-573e-4eca-b61f-f9bf6e68de72 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:27.936986 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d1242aa-573e-4eca-b61f-f9bf6e68de72 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:27.937426 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d1242aa-573e-4eca-b61f-f9bf6e68de72 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:27.937839 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d1242aa-573e-4eca-b61f-f9bf6e68de72 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:27.957846 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2c48662a-260a-4f24-9ea3-d887d687ce4e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:27.958442 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2c48662a-260a-4f24-9ea3-d887d687ce4e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:27.964324 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c48662a-260a-4f24-9ea3-d887d687ce4e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:27.964803 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c48662a-260a-4f24-9ea3-d887d687ce4e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:27.965235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c48662a-260a-4f24-9ea3-d887d687ce4e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:27.965922 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c48662a-260a-4f24-9ea3-d887d687ce4e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:27.966388 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c48662a-260a-4f24-9ea3-d887d687ce4e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:27.966790 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c48662a-260a-4f24-9ea3-d887d687ce4e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:28.121259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4d1242aa-573e-4eca-b61f-f9bf6e68de72 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:28.130238 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4d1242aa-573e-4eca-b61f-f9bf6e68de72 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.205518 Aug 29 19:02:28.130977 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 64/116] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:27 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:28.148917 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2c48662a-260a-4f24-9ea3-d887d687ce4e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:28.156763 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2c48662a-260a-4f24-9ea3-d887d687ce4e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.202753 Aug 29 19:02:28.157343 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 53/117] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:27 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:28.513000 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b8e254dd-7094-459d-97cf-856801f41235 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:28.513609 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b8e254dd-7094-459d-97cf-856801f41235 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:28.519553 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8e254dd-7094-459d-97cf-856801f41235 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:28.520035 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8e254dd-7094-459d-97cf-856801f41235 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:28.520466 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8e254dd-7094-459d-97cf-856801f41235 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:28.521183 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8e254dd-7094-459d-97cf-856801f41235 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:28.521636 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8e254dd-7094-459d-97cf-856801f41235 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:28.522066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8e254dd-7094-459d-97cf-856801f41235 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:28.648295 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b8e254dd-7094-459d-97cf-856801f41235 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:28.656032 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b8e254dd-7094-459d-97cf-856801f41235 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.146737 Aug 29 19:02:28.656599 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 65/118] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:28 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:28.725342 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0d750806-ba4f-4109-af3c-e214ee76124d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:28.725953 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0d750806-ba4f-4109-af3c-e214ee76124d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:28.731991 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d750806-ba4f-4109-af3c-e214ee76124d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:28.732473 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d750806-ba4f-4109-af3c-e214ee76124d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:28.732905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d750806-ba4f-4109-af3c-e214ee76124d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:28.734138 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d750806-ba4f-4109-af3c-e214ee76124d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:28.734586 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d750806-ba4f-4109-af3c-e214ee76124d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:28.735026 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d750806-ba4f-4109-af3c-e214ee76124d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:28.863390 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0d750806-ba4f-4109-af3c-e214ee76124d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:28.871440 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0d750806-ba4f-4109-af3c-e214ee76124d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:28.872889 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0d750806-ba4f-4109-af3c-e214ee76124d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:28.873995 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0d750806-ba4f-4109-af3c-e214ee76124d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.152650 Aug 29 19:02:28.874555 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 54/119] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:28 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:29.151319 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7596b731-827d-4c4f-bef6-4ddabb73f696 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:29.151921 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7596b731-827d-4c4f-bef6-4ddabb73f696 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:29.158511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7596b731-827d-4c4f-bef6-4ddabb73f696 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:29.158984 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7596b731-827d-4c4f-bef6-4ddabb73f696 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:29.159434 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7596b731-827d-4c4f-bef6-4ddabb73f696 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:29.160101 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7596b731-827d-4c4f-bef6-4ddabb73f696 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:29.160543 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7596b731-827d-4c4f-bef6-4ddabb73f696 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:29.160956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7596b731-827d-4c4f-bef6-4ddabb73f696 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:29.178725 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2e3339da-ed37-43e3-9655-71345bd0617b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:29.179361 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2e3339da-ed37-43e3-9655-71345bd0617b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:29.185216 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3339da-ed37-43e3-9655-71345bd0617b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:29.185700 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3339da-ed37-43e3-9655-71345bd0617b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:29.186134 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3339da-ed37-43e3-9655-71345bd0617b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:29.186870 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3339da-ed37-43e3-9655-71345bd0617b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:29.187531 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3339da-ed37-43e3-9655-71345bd0617b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:29.187949 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3339da-ed37-43e3-9655-71345bd0617b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:29.347908 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7596b731-827d-4c4f-bef6-4ddabb73f696 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:29.355629 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7596b731-827d-4c4f-bef6-4ddabb73f696 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.208121 Aug 29 19:02:29.356197 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 66/120] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:29 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:29.365128 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2e3339da-ed37-43e3-9655-71345bd0617b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:29.372661 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2e3339da-ed37-43e3-9655-71345bd0617b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.197737 Aug 29 19:02:29.373217 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 55/121] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:29 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:29.676969 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c5d8ef98-0860-4ef0-b73e-1b675d556579 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:29.677575 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c5d8ef98-0860-4ef0-b73e-1b675d556579 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:29.683665 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c5d8ef98-0860-4ef0-b73e-1b675d556579 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:29.684076 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c5d8ef98-0860-4ef0-b73e-1b675d556579 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:29.684500 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c5d8ef98-0860-4ef0-b73e-1b675d556579 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:29.685179 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c5d8ef98-0860-4ef0-b73e-1b675d556579 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:29.685622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c5d8ef98-0860-4ef0-b73e-1b675d556579 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:29.686039 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c5d8ef98-0860-4ef0-b73e-1b675d556579 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:29.814860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c5d8ef98-0860-4ef0-b73e-1b675d556579 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:29.822603 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c5d8ef98-0860-4ef0-b73e-1b675d556579 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.149562 Aug 29 19:02:29.823178 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 67/122] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:29 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:29.896549 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ade74b65-a6b4-47cd-9961-2a08b6022eaf tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:29.897150 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ade74b65-a6b4-47cd-9961-2a08b6022eaf tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:29.903209 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ade74b65-a6b4-47cd-9961-2a08b6022eaf tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:29.903715 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ade74b65-a6b4-47cd-9961-2a08b6022eaf tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:29.904144 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ade74b65-a6b4-47cd-9961-2a08b6022eaf tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:29.904815 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ade74b65-a6b4-47cd-9961-2a08b6022eaf tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:29.906038 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ade74b65-a6b4-47cd-9961-2a08b6022eaf tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:29.906455 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ade74b65-a6b4-47cd-9961-2a08b6022eaf tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:30.034318 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ade74b65-a6b4-47cd-9961-2a08b6022eaf tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:30.042431 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ade74b65-a6b4-47cd-9961-2a08b6022eaf tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:30.044009 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ade74b65-a6b4-47cd-9961-2a08b6022eaf tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:30.045103 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ade74b65-a6b4-47cd-9961-2a08b6022eaf tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.152462 Aug 29 19:02:30.045673 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 56/123] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:29 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:30.376473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ec2baa81-d024-4638-af10-6570f628dcf8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:30.377079 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ec2baa81-d024-4638-af10-6570f628dcf8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:30.382886 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ec2baa81-d024-4638-af10-6570f628dcf8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:30.383405 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ec2baa81-d024-4638-af10-6570f628dcf8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:30.383836 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ec2baa81-d024-4638-af10-6570f628dcf8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:30.384517 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ec2baa81-d024-4638-af10-6570f628dcf8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:30.384966 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ec2baa81-d024-4638-af10-6570f628dcf8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:30.385385 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ec2baa81-d024-4638-af10-6570f628dcf8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:30.393382 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-32da1448-2a58-4636-9ef9-b10845873091 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:30.393995 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-32da1448-2a58-4636-9ef9-b10845873091 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:30.400213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32da1448-2a58-4636-9ef9-b10845873091 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:30.400773 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32da1448-2a58-4636-9ef9-b10845873091 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:30.401210 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32da1448-2a58-4636-9ef9-b10845873091 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:30.401999 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32da1448-2a58-4636-9ef9-b10845873091 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:30.402449 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32da1448-2a58-4636-9ef9-b10845873091 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:30.402891 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32da1448-2a58-4636-9ef9-b10845873091 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:30.586194 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ec2baa81-d024-4638-af10-6570f628dcf8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:30.589930 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-32da1448-2a58-4636-9ef9-b10845873091 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:30.596185 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ec2baa81-d024-4638-af10-6570f628dcf8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.223958 Aug 29 19:02:30.596882 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 68/124] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:30 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:30.597729 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-32da1448-2a58-4636-9ef9-b10845873091 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.208584 Aug 29 19:02:30.598286 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 57/125] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:30 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:30.843740 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0db6c132-ab70-49c7-ab19-38a984d08a6e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:30.844286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0db6c132-ab70-49c7-ab19-38a984d08a6e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:30.850214 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0db6c132-ab70-49c7-ab19-38a984d08a6e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:30.850699 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0db6c132-ab70-49c7-ab19-38a984d08a6e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:30.851156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0db6c132-ab70-49c7-ab19-38a984d08a6e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:30.851833 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0db6c132-ab70-49c7-ab19-38a984d08a6e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:30.852279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0db6c132-ab70-49c7-ab19-38a984d08a6e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:30.852695 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0db6c132-ab70-49c7-ab19-38a984d08a6e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:30.978780 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0db6c132-ab70-49c7-ab19-38a984d08a6e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:30.986840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0db6c132-ab70-49c7-ab19-38a984d08a6e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.147171 Aug 29 19:02:30.987417 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 69/126] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:30 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:31.068346 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-47831dcf-02e5-4acd-b802-6d386a1edda0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:31.068982 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-47831dcf-02e5-4acd-b802-6d386a1edda0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:31.074972 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47831dcf-02e5-4acd-b802-6d386a1edda0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:31.075483 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47831dcf-02e5-4acd-b802-6d386a1edda0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:31.075999 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47831dcf-02e5-4acd-b802-6d386a1edda0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:31.076692 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47831dcf-02e5-4acd-b802-6d386a1edda0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:31.077230 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47831dcf-02e5-4acd-b802-6d386a1edda0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:31.077768 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47831dcf-02e5-4acd-b802-6d386a1edda0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:31.207529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-47831dcf-02e5-4acd-b802-6d386a1edda0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:31.215640 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-47831dcf-02e5-4acd-b802-6d386a1edda0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:31.217169 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-47831dcf-02e5-4acd-b802-6d386a1edda0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:31.218763 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-47831dcf-02e5-4acd-b802-6d386a1edda0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.154818 Aug 29 19:02:31.219379 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 58/127] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:31 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:31.621975 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9adf4f3a-f12b-4854-96d8-342e31a4c0ea tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:31.622812 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9adf4f3a-f12b-4854-96d8-342e31a4c0ea tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:31.624671 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-722462db-f9a9-4aa5-ba83-03e670103a27 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:31.625464 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-722462db-f9a9-4aa5-ba83-03e670103a27 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:31.631226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9adf4f3a-f12b-4854-96d8-342e31a4c0ea tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:31.632113 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9adf4f3a-f12b-4854-96d8-342e31a4c0ea tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:31.632981 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9adf4f3a-f12b-4854-96d8-342e31a4c0ea tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:31.634363 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-722462db-f9a9-4aa5-ba83-03e670103a27 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:31.634918 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-722462db-f9a9-4aa5-ba83-03e670103a27 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:31.635538 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9adf4f3a-f12b-4854-96d8-342e31a4c0ea tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:31.635661 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-722462db-f9a9-4aa5-ba83-03e670103a27 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:31.636848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-722462db-f9a9-4aa5-ba83-03e670103a27 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:31.637196 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-722462db-f9a9-4aa5-ba83-03e670103a27 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:31.637495 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9adf4f3a-f12b-4854-96d8-342e31a4c0ea tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:31.637737 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-722462db-f9a9-4aa5-ba83-03e670103a27 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:31.638256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9adf4f3a-f12b-4854-96d8-342e31a4c0ea tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:31.883317 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-722462db-f9a9-4aa5-ba83-03e670103a27 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:31.891874 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-722462db-f9a9-4aa5-ba83-03e670103a27 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.273803 Aug 29 19:02:31.892597 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9adf4f3a-f12b-4854-96d8-342e31a4c0ea tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:31.897925 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 59/128] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:31 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:31.901720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9adf4f3a-f12b-4854-96d8-342e31a4c0ea tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.284272 Aug 29 19:02:31.902466 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 70/129] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:31 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:32.007490 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ac21b9b0-406c-474c-9529-bbc151014c87 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:32.008100 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ac21b9b0-406c-474c-9529-bbc151014c87 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:32.017894 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac21b9b0-406c-474c-9529-bbc151014c87 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:32.018579 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac21b9b0-406c-474c-9529-bbc151014c87 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:32.019059 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac21b9b0-406c-474c-9529-bbc151014c87 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:32.019750 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac21b9b0-406c-474c-9529-bbc151014c87 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:32.020193 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac21b9b0-406c-474c-9529-bbc151014c87 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:32.020607 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac21b9b0-406c-474c-9529-bbc151014c87 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:32.161929 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ac21b9b0-406c-474c-9529-bbc151014c87 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:32.175239 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ac21b9b0-406c-474c-9529-bbc151014c87 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.171389 Aug 29 19:02:32.176150 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 60/130] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:32 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:32.241360 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-52f0477b-a241-4b1d-afc7-c3e149d61963 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:32.242012 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-52f0477b-a241-4b1d-afc7-c3e149d61963 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:32.248111 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-52f0477b-a241-4b1d-afc7-c3e149d61963 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:32.248590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-52f0477b-a241-4b1d-afc7-c3e149d61963 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:32.249037 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-52f0477b-a241-4b1d-afc7-c3e149d61963 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:32.250486 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-52f0477b-a241-4b1d-afc7-c3e149d61963 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:32.250923 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-52f0477b-a241-4b1d-afc7-c3e149d61963 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:32.251359 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-52f0477b-a241-4b1d-afc7-c3e149d61963 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:32.587744 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-52f0477b-a241-4b1d-afc7-c3e149d61963 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:32.596575 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-52f0477b-a241-4b1d-afc7-c3e149d61963 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:32.598055 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-52f0477b-a241-4b1d-afc7-c3e149d61963 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:32.599187 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-52f0477b-a241-4b1d-afc7-c3e149d61963 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.362108 Aug 29 19:02:32.599735 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 71/131] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:32 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:32.922022 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b2d24469-d778-4f01-b725-a8a5e7eab7be tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:32.922022 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b2d24469-d778-4f01-b725-a8a5e7eab7be tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:32.925846 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2d24469-d778-4f01-b725-a8a5e7eab7be tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:32.926335 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2d24469-d778-4f01-b725-a8a5e7eab7be tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:32.926759 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2d24469-d778-4f01-b725-a8a5e7eab7be tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:32.927472 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2d24469-d778-4f01-b725-a8a5e7eab7be tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:32.927914 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2d24469-d778-4f01-b725-a8a5e7eab7be tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:32.928334 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2d24469-d778-4f01-b725-a8a5e7eab7be tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:32.928437 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bc2f6bd4-3997-4599-b10f-d9f9a54a3fe3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:32.930441 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bc2f6bd4-3997-4599-b10f-d9f9a54a3fe3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:32.941060 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bc2f6bd4-3997-4599-b10f-d9f9a54a3fe3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:32.941549 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bc2f6bd4-3997-4599-b10f-d9f9a54a3fe3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:32.942002 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bc2f6bd4-3997-4599-b10f-d9f9a54a3fe3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:32.942955 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bc2f6bd4-3997-4599-b10f-d9f9a54a3fe3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:32.943419 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bc2f6bd4-3997-4599-b10f-d9f9a54a3fe3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:32.943840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bc2f6bd4-3997-4599-b10f-d9f9a54a3fe3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:33.154789 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b2d24469-d778-4f01-b725-a8a5e7eab7be tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:33.156917 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bc2f6bd4-3997-4599-b10f-d9f9a54a3fe3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:33.165207 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bc2f6bd4-3997-4599-b10f-d9f9a54a3fe3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.241666 Aug 29 19:02:33.165780 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 72/132] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:32 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:33.167209 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b2d24469-d778-4f01-b725-a8a5e7eab7be tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.252733 Aug 29 19:02:33.168849 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 61/133] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:32 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:33.196834 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fa29f2d9-beff-4c5b-942e-44ea2fc868b9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:33.197360 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fa29f2d9-beff-4c5b-942e-44ea2fc868b9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:33.203434 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa29f2d9-beff-4c5b-942e-44ea2fc868b9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:33.203922 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa29f2d9-beff-4c5b-942e-44ea2fc868b9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:33.204347 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa29f2d9-beff-4c5b-942e-44ea2fc868b9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:33.205025 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa29f2d9-beff-4c5b-942e-44ea2fc868b9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:33.205468 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa29f2d9-beff-4c5b-942e-44ea2fc868b9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:33.205881 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa29f2d9-beff-4c5b-942e-44ea2fc868b9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:33.347983 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fa29f2d9-beff-4c5b-942e-44ea2fc868b9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:33.356438 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fa29f2d9-beff-4c5b-942e-44ea2fc868b9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.163677 Aug 29 19:02:33.368332 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 73/134] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:33 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:33.623552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cca3a0e5-f591-4392-b9dc-42bf0bbba5e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:33.624986 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cca3a0e5-f591-4392-b9dc-42bf0bbba5e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:33.631462 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cca3a0e5-f591-4392-b9dc-42bf0bbba5e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:33.631952 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cca3a0e5-f591-4392-b9dc-42bf0bbba5e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:33.632385 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cca3a0e5-f591-4392-b9dc-42bf0bbba5e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:33.633080 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cca3a0e5-f591-4392-b9dc-42bf0bbba5e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:33.633525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cca3a0e5-f591-4392-b9dc-42bf0bbba5e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:33.633947 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cca3a0e5-f591-4392-b9dc-42bf0bbba5e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:33.787117 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cca3a0e5-f591-4392-b9dc-42bf0bbba5e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:33.797422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cca3a0e5-f591-4392-b9dc-42bf0bbba5e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:33.799025 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cca3a0e5-f591-4392-b9dc-42bf0bbba5e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:33.800355 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cca3a0e5-f591-4392-b9dc-42bf0bbba5e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.181088 Aug 29 19:02:33.801754 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 62/135] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:33 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:34.193959 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-74dcc69e-832b-4c5a-afcc-bef61cb92382 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:34.196469 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1422e1a6-b61c-4eae-9ec7-c8039625829e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:34.197615 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1422e1a6-b61c-4eae-9ec7-c8039625829e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:34.198452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-74dcc69e-832b-4c5a-afcc-bef61cb92382 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:34.210948 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74dcc69e-832b-4c5a-afcc-bef61cb92382 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:34.212486 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1422e1a6-b61c-4eae-9ec7-c8039625829e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:34.213337 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1422e1a6-b61c-4eae-9ec7-c8039625829e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:34.213957 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1422e1a6-b61c-4eae-9ec7-c8039625829e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:34.214826 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1422e1a6-b61c-4eae-9ec7-c8039625829e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:34.215523 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74dcc69e-832b-4c5a-afcc-bef61cb92382 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:34.216153 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1422e1a6-b61c-4eae-9ec7-c8039625829e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:34.216928 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74dcc69e-832b-4c5a-afcc-bef61cb92382 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:34.217534 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1422e1a6-b61c-4eae-9ec7-c8039625829e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:34.218937 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74dcc69e-832b-4c5a-afcc-bef61cb92382 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:34.222253 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74dcc69e-832b-4c5a-afcc-bef61cb92382 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:34.222911 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74dcc69e-832b-4c5a-afcc-bef61cb92382 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:34.462014 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1422e1a6-b61c-4eae-9ec7-c8039625829e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:34.464740 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-74dcc69e-832b-4c5a-afcc-bef61cb92382 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:34.473136 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-74dcc69e-832b-4c5a-afcc-bef61cb92382 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.285764 Aug 29 19:02:34.476198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1422e1a6-b61c-4eae-9ec7-c8039625829e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.289984 Aug 29 19:02:34.477659 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 74/136] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:34 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:34.488793 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 63/137] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:34 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:34.490140 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9f5c3d65-5a9d-460e-8c7c-7eefae985ec9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:34.492236 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9f5c3d65-5a9d-460e-8c7c-7eefae985ec9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:34.506803 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9f5c3d65-5a9d-460e-8c7c-7eefae985ec9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:34.507575 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9f5c3d65-5a9d-460e-8c7c-7eefae985ec9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:34.508243 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9f5c3d65-5a9d-460e-8c7c-7eefae985ec9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:34.509342 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9f5c3d65-5a9d-460e-8c7c-7eefae985ec9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:34.509965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9f5c3d65-5a9d-460e-8c7c-7eefae985ec9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:34.510851 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9f5c3d65-5a9d-460e-8c7c-7eefae985ec9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:34.660913 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9f5c3d65-5a9d-460e-8c7c-7eefae985ec9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:34.669049 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9f5c3d65-5a9d-460e-8c7c-7eefae985ec9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.188643 Aug 29 19:02:34.669966 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 75/138] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:34 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:34.831257 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-143a9364-e6d3-4d4a-9782-75e2849fa33c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:34.831257 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-143a9364-e6d3-4d4a-9782-75e2849fa33c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:34.834059 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-143a9364-e6d3-4d4a-9782-75e2849fa33c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:34.834587 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-143a9364-e6d3-4d4a-9782-75e2849fa33c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:34.835041 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-143a9364-e6d3-4d4a-9782-75e2849fa33c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:34.835875 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-143a9364-e6d3-4d4a-9782-75e2849fa33c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:34.836534 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-143a9364-e6d3-4d4a-9782-75e2849fa33c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:34.836957 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-143a9364-e6d3-4d4a-9782-75e2849fa33c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:35.010427 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-143a9364-e6d3-4d4a-9782-75e2849fa33c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:35.021110 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-143a9364-e6d3-4d4a-9782-75e2849fa33c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:35.024376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-143a9364-e6d3-4d4a-9782-75e2849fa33c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:35.025648 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-143a9364-e6d3-4d4a-9782-75e2849fa33c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.204818 Aug 29 19:02:35.026916 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 64/139] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:34 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:35.502702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3c1ed182-bea5-4938-aeb4-33cfe4d5bf9c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:35.503465 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3c1ed182-bea5-4938-aeb4-33cfe4d5bf9c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:35.507320 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5eef61b4-139f-4d22-986d-1de7c715d7e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:35.507968 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5eef61b4-139f-4d22-986d-1de7c715d7e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:35.515125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c1ed182-bea5-4938-aeb4-33cfe4d5bf9c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:35.515630 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c1ed182-bea5-4938-aeb4-33cfe4d5bf9c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:35.515904 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5eef61b4-139f-4d22-986d-1de7c715d7e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:35.516057 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c1ed182-bea5-4938-aeb4-33cfe4d5bf9c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:35.516941 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5eef61b4-139f-4d22-986d-1de7c715d7e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:35.517380 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5eef61b4-139f-4d22-986d-1de7c715d7e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:35.518078 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5eef61b4-139f-4d22-986d-1de7c715d7e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:35.518574 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5eef61b4-139f-4d22-986d-1de7c715d7e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:35.519028 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5eef61b4-139f-4d22-986d-1de7c715d7e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:35.533517 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c1ed182-bea5-4938-aeb4-33cfe4d5bf9c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:35.534291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c1ed182-bea5-4938-aeb4-33cfe4d5bf9c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:35.534745 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c1ed182-bea5-4938-aeb4-33cfe4d5bf9c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:36.036321 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5eef61b4-139f-4d22-986d-1de7c715d7e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:36.053044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5eef61b4-139f-4d22-986d-1de7c715d7e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.556813 Aug 29 19:02:36.062954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 65/140] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:35 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:36.079683 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-40c826c9-4a47-40d5-ae14-2a9cc1b77cd3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:36.080423 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-40c826c9-4a47-40d5-ae14-2a9cc1b77cd3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:36.107311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-40c826c9-4a47-40d5-ae14-2a9cc1b77cd3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:36.108078 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-40c826c9-4a47-40d5-ae14-2a9cc1b77cd3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:36.112534 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-40c826c9-4a47-40d5-ae14-2a9cc1b77cd3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:36.113313 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-40c826c9-4a47-40d5-ae14-2a9cc1b77cd3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:36.118926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-40c826c9-4a47-40d5-ae14-2a9cc1b77cd3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:36.119607 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-40c826c9-4a47-40d5-ae14-2a9cc1b77cd3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:36.139161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3c1ed182-bea5-4938-aeb4-33cfe4d5bf9c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:36.155638 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3c1ed182-bea5-4938-aeb4-33cfe4d5bf9c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.663115 Aug 29 19:02:36.157995 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 76/141] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:35 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:36.203202 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:36.203896 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-de46482a-c083-4090-b9e1-7106b7b175bc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:36.204784 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-de46482a-c083-4090-b9e1-7106b7b175bc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:36.230265 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-de46482a-c083-4090-b9e1-7106b7b175bc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:36.232415 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-de46482a-c083-4090-b9e1-7106b7b175bc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:36.234158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-de46482a-c083-4090-b9e1-7106b7b175bc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:36.239800 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-de46482a-c083-4090-b9e1-7106b7b175bc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:36.240410 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-de46482a-c083-4090-b9e1-7106b7b175bc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:36.240971 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-de46482a-c083-4090-b9e1-7106b7b175bc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:36.587560 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-de46482a-c083-4090-b9e1-7106b7b175bc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:36.598638 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-de46482a-c083-4090-b9e1-7106b7b175bc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:36.600512 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-de46482a-c083-4090-b9e1-7106b7b175bc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:36.602006 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-de46482a-c083-4090-b9e1-7106b7b175bc tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.415630 Aug 29 19:02:36.615652 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 77/142] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:36 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:36.625785 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-e1cd154c-3b45-4607-a447-ce5a3602358d req-b62afc3c-c896-47ad-84c7-b6d6e3f53e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e88e76a-d978-4b39-89f0-d1dd5a154250", "name": "network-vif-plugged", "status": "completed", "tag": "9b7379ea-5177-4f98-8727-d75f6b260a12"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:02:36.637638 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-e1cd154c-3b45-4607-a447-ce5a3602358d req-b62afc3c-c896-47ad-84c7-b6d6e3f53e85 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:36.638538 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-e1cd154c-3b45-4607-a447-ce5a3602358d req-b62afc3c-c896-47ad-84c7-b6d6e3f53e85 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:36.642922 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-e1cd154c-3b45-4607-a447-ce5a3602358d req-b62afc3c-c896-47ad-84c7-b6d6e3f53e85 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:36.653014 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-40c826c9-4a47-40d5-ae14-2a9cc1b77cd3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:36.662678 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-40c826c9-4a47-40d5-ae14-2a9cc1b77cd3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.598566 Aug 29 19:02:36.663348 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-e1cd154c-3b45-4607-a447-ce5a3602358d req-b62afc3c-c896-47ad-84c7-b6d6e3f53e85 service nova] Creating event network-vif-plugged:9b7379ea-5177-4f98-8727-d75f6b260a12 for instance 2e88e76a-d978-4b39-89f0-d1dd5a154250 on hv-cinder-85083 Aug 29 19:02:36.671791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-e1cd154c-3b45-4607-a447-ce5a3602358d req-b62afc3c-c896-47ad-84c7-b6d6e3f53e85 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053915 Aug 29 19:02:36.672013 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 66/143] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:36 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:36.674428 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 78/144] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:02:37.089917 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-aa5001b7-cf47-4207-9668-57dc4b8b7b05 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:37.090955 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-aa5001b7-cf47-4207-9668-57dc4b8b7b05 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:37.104092 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa5001b7-cf47-4207-9668-57dc4b8b7b05 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:37.105190 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa5001b7-cf47-4207-9668-57dc4b8b7b05 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:37.105901 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa5001b7-cf47-4207-9668-57dc4b8b7b05 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:37.107914 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa5001b7-cf47-4207-9668-57dc4b8b7b05 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:37.110670 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa5001b7-cf47-4207-9668-57dc4b8b7b05 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:37.114039 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa5001b7-cf47-4207-9668-57dc4b8b7b05 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:37.190249 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5c65c739-04c6-4ab0-b194-981af744bb34 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:37.193386 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5c65c739-04c6-4ab0-b194-981af744bb34 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:37.216583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c65c739-04c6-4ab0-b194-981af744bb34 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:37.218615 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c65c739-04c6-4ab0-b194-981af744bb34 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:37.220226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c65c739-04c6-4ab0-b194-981af744bb34 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:37.222609 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c65c739-04c6-4ab0-b194-981af744bb34 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:37.223745 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c65c739-04c6-4ab0-b194-981af744bb34 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:37.225316 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c65c739-04c6-4ab0-b194-981af744bb34 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:37.461777 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-aa5001b7-cf47-4207-9668-57dc4b8b7b05 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:37.472475 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-aa5001b7-cf47-4207-9668-57dc4b8b7b05 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.388849 Aug 29 19:02:37.475679 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 67/145] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:37 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:37.482132 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5c65c739-04c6-4ab0-b194-981af744bb34 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:37.493183 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5c65c739-04c6-4ab0-b194-981af744bb34 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.309836 Aug 29 19:02:37.493759 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 79/146] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:37 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:37.630837 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-18a695e5-abed-4733-a703-64a86f914ab9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:37.631785 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-18a695e5-abed-4733-a703-64a86f914ab9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:37.638380 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18a695e5-abed-4733-a703-64a86f914ab9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:37.638866 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18a695e5-abed-4733-a703-64a86f914ab9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:37.639372 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18a695e5-abed-4733-a703-64a86f914ab9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:37.640358 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18a695e5-abed-4733-a703-64a86f914ab9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:37.640806 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18a695e5-abed-4733-a703-64a86f914ab9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:37.641390 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18a695e5-abed-4733-a703-64a86f914ab9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:37.688194 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-095502ec-81e3-47ea-b8dd-1b43a6588b07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:37.689550 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-095502ec-81e3-47ea-b8dd-1b43a6588b07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:37.700621 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-095502ec-81e3-47ea-b8dd-1b43a6588b07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:37.701349 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-095502ec-81e3-47ea-b8dd-1b43a6588b07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:37.701972 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-095502ec-81e3-47ea-b8dd-1b43a6588b07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:37.702787 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-095502ec-81e3-47ea-b8dd-1b43a6588b07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:37.703435 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-095502ec-81e3-47ea-b8dd-1b43a6588b07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:37.703857 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-095502ec-81e3-47ea-b8dd-1b43a6588b07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:37.911705 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-18a695e5-abed-4733-a703-64a86f914ab9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:37.927941 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-18a695e5-abed-4733-a703-64a86f914ab9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:37.929505 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-18a695e5-abed-4733-a703-64a86f914ab9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:37.930636 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-18a695e5-abed-4733-a703-64a86f914ab9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.305191 Aug 29 19:02:37.931385 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 68/147] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:37 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:02:37.954337 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-095502ec-81e3-47ea-b8dd-1b43a6588b07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:37.976444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-095502ec-81e3-47ea-b8dd-1b43a6588b07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.292543 Aug 29 19:02:37.977030 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 80/148] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:37 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:38.495966 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-328e62c9-20d7-4445-8650-ac4bce2e93da tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:38.496821 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-328e62c9-20d7-4445-8650-ac4bce2e93da tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:38.504725 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-328e62c9-20d7-4445-8650-ac4bce2e93da tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:38.505242 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-328e62c9-20d7-4445-8650-ac4bce2e93da tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:38.505643 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-328e62c9-20d7-4445-8650-ac4bce2e93da tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:38.506586 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-328e62c9-20d7-4445-8650-ac4bce2e93da tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:38.507045 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-328e62c9-20d7-4445-8650-ac4bce2e93da tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:38.507632 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-328e62c9-20d7-4445-8650-ac4bce2e93da tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:38.514176 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0dabcea2-58c9-455b-8455-544cac51b08d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:38.515158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0dabcea2-58c9-455b-8455-544cac51b08d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:38.521530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0dabcea2-58c9-455b-8455-544cac51b08d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:38.527251 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0dabcea2-58c9-455b-8455-544cac51b08d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:38.527701 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0dabcea2-58c9-455b-8455-544cac51b08d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:38.535829 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0dabcea2-58c9-455b-8455-544cac51b08d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:38.536694 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0dabcea2-58c9-455b-8455-544cac51b08d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:38.537328 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0dabcea2-58c9-455b-8455-544cac51b08d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:38.542067 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:38.889880 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0dabcea2-58c9-455b-8455-544cac51b08d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:38.897965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0dabcea2-58c9-455b-8455-544cac51b08d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.388111 Aug 29 19:02:38.907532 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 81/149] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:38 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:38.941700 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-328e62c9-20d7-4445-8650-ac4bce2e93da tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:38.954716 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-328e62c9-20d7-4445-8650-ac4bce2e93da tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.462580 Aug 29 19:02:38.955240 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 69/150] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:38 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:38.962271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5d691449-1260-4b2b-914a-b5cf62faf81f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:38.962933 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5d691449-1260-4b2b-914a-b5cf62faf81f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:38.973797 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5d691449-1260-4b2b-914a-b5cf62faf81f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:38.974289 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5d691449-1260-4b2b-914a-b5cf62faf81f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:38.974770 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5d691449-1260-4b2b-914a-b5cf62faf81f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:38.976469 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5d691449-1260-4b2b-914a-b5cf62faf81f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:38.977443 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5d691449-1260-4b2b-914a-b5cf62faf81f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:38.977898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5d691449-1260-4b2b-914a-b5cf62faf81f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:38.999634 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-539441a3-05ce-4270-8f9d-926f0ba0cea6 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:39.000394 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-539441a3-05ce-4270-8f9d-926f0ba0cea6 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:39.008026 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-539441a3-05ce-4270-8f9d-926f0ba0cea6 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:39.008513 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-539441a3-05ce-4270-8f9d-926f0ba0cea6 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:39.008942 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-539441a3-05ce-4270-8f9d-926f0ba0cea6 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:39.009630 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-539441a3-05ce-4270-8f9d-926f0ba0cea6 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:39.010116 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-539441a3-05ce-4270-8f9d-926f0ba0cea6 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:39.010522 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-539441a3-05ce-4270-8f9d-926f0ba0cea6 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:39.202372 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5d691449-1260-4b2b-914a-b5cf62faf81f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:39.218527 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5d691449-1260-4b2b-914a-b5cf62faf81f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:39.220396 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5d691449-1260-4b2b-914a-b5cf62faf81f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:39.221808 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5d691449-1260-4b2b-914a-b5cf62faf81f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.269976 Aug 29 19:02:39.223096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 82/151] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:38 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:39.234083 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-539441a3-05ce-4270-8f9d-926f0ba0cea6 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:39.242552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-539441a3-05ce-4270-8f9d-926f0ba0cea6 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.247066 Aug 29 19:02:39.243055 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 70/152] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:38 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:39.925624 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1d2fd9c8-8d02-4c5d-9b37-9be673ccdf56 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:39.926243 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1d2fd9c8-8d02-4c5d-9b37-9be673ccdf56 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:39.937328 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d2fd9c8-8d02-4c5d-9b37-9be673ccdf56 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:39.937839 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d2fd9c8-8d02-4c5d-9b37-9be673ccdf56 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:39.938318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d2fd9c8-8d02-4c5d-9b37-9be673ccdf56 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:39.939072 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d2fd9c8-8d02-4c5d-9b37-9be673ccdf56 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:39.939750 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d2fd9c8-8d02-4c5d-9b37-9be673ccdf56 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:39.940329 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d2fd9c8-8d02-4c5d-9b37-9be673ccdf56 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:39.978603 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8f75baeb-0123-4b55-b521-cf26c892624c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:39.980010 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8f75baeb-0123-4b55-b521-cf26c892624c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:39.992685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f75baeb-0123-4b55-b521-cf26c892624c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:39.994170 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f75baeb-0123-4b55-b521-cf26c892624c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:39.996822 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f75baeb-0123-4b55-b521-cf26c892624c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:39.998205 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f75baeb-0123-4b55-b521-cf26c892624c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:40.000033 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f75baeb-0123-4b55-b521-cf26c892624c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:40.002220 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f75baeb-0123-4b55-b521-cf26c892624c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:40.735588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1d2fd9c8-8d02-4c5d-9b37-9be673ccdf56 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:40.749611 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1d2fd9c8-8d02-4c5d-9b37-9be673ccdf56 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.829996 Aug 29 19:02:40.751492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 83/153] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:39 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:40.761231 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8f75baeb-0123-4b55-b521-cf26c892624c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:40.765086 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-b96e4808-9f31-4a9d-a982-029210868a3f req-ad123391-6120-4e5c-a2d7-bbedaf084102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4429ad44-4714-483b-b5b3-0091aabe6905", "name": "network-vif-plugged", "status": "completed", "tag": "cf8e3469-e506-47a4-b46f-3674e9c0abab"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:02:40.770183 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8f75baeb-0123-4b55-b521-cf26c892624c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.797110 Aug 29 19:02:40.776740 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 71/154] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:39 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:40.785301 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-546ec402-799d-4289-a46f-b9e59d6d8eda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:40.787736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-b96e4808-9f31-4a9d-a982-029210868a3f req-ad123391-6120-4e5c-a2d7-bbedaf084102 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:40.788397 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-546ec402-799d-4289-a46f-b9e59d6d8eda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:40.790437 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-b96e4808-9f31-4a9d-a982-029210868a3f req-ad123391-6120-4e5c-a2d7-bbedaf084102 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:40.792103 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-b96e4808-9f31-4a9d-a982-029210868a3f req-ad123391-6120-4e5c-a2d7-bbedaf084102 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:40.799621 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-546ec402-799d-4289-a46f-b9e59d6d8eda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:40.800301 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-546ec402-799d-4289-a46f-b9e59d6d8eda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:40.800894 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-546ec402-799d-4289-a46f-b9e59d6d8eda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:40.801748 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-546ec402-799d-4289-a46f-b9e59d6d8eda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:40.802457 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-546ec402-799d-4289-a46f-b9e59d6d8eda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:40.803044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-546ec402-799d-4289-a46f-b9e59d6d8eda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:40.804315 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-b96e4808-9f31-4a9d-a982-029210868a3f req-ad123391-6120-4e5c-a2d7-bbedaf084102 service nova] Creating event network-vif-plugged:cf8e3469-e506-47a4-b46f-3674e9c0abab for instance 4429ad44-4714-483b-b5b3-0091aabe6905 on hv-cinder-85083 Aug 29 19:02:40.819335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-b96e4808-9f31-4a9d-a982-029210868a3f req-ad123391-6120-4e5c-a2d7-bbedaf084102 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064872 Aug 29 19:02:40.823772 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 84/155] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:02:40.829096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-847a1e87-3d4a-4612-8d12-0baf1611304d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:40.830005 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-847a1e87-3d4a-4612-8d12-0baf1611304d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:40.836650 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-847a1e87-3d4a-4612-8d12-0baf1611304d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:40.837337 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-847a1e87-3d4a-4612-8d12-0baf1611304d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:40.837952 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-847a1e87-3d4a-4612-8d12-0baf1611304d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:40.838651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-847a1e87-3d4a-4612-8d12-0baf1611304d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:40.839125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-847a1e87-3d4a-4612-8d12-0baf1611304d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:40.839695 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-847a1e87-3d4a-4612-8d12-0baf1611304d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:41.000033 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-546ec402-799d-4289-a46f-b9e59d6d8eda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:41.009661 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-546ec402-799d-4289-a46f-b9e59d6d8eda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:41.011135 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-546ec402-799d-4289-a46f-b9e59d6d8eda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:41.012525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-546ec402-799d-4289-a46f-b9e59d6d8eda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.234724 Aug 29 19:02:41.013640 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 72/156] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:40 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:41.044564 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-847a1e87-3d4a-4612-8d12-0baf1611304d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:41.054208 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-847a1e87-3d4a-4612-8d12-0baf1611304d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.229089 Aug 29 19:02:41.054934 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 85/157] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:40 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:41.774358 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-094839a0-9ccb-4e98-8b3e-e8a6301de1f0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:41.775949 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-094839a0-9ccb-4e98-8b3e-e8a6301de1f0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:41.788886 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-094839a0-9ccb-4e98-8b3e-e8a6301de1f0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:41.789499 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-094839a0-9ccb-4e98-8b3e-e8a6301de1f0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:41.789992 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-094839a0-9ccb-4e98-8b3e-e8a6301de1f0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:41.791089 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-094839a0-9ccb-4e98-8b3e-e8a6301de1f0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:41.791604 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-094839a0-9ccb-4e98-8b3e-e8a6301de1f0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:41.792087 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-094839a0-9ccb-4e98-8b3e-e8a6301de1f0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:41.803680 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-55a1b082-90f1-4490-89d3-7cf63668f8fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:41.805146 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-55a1b082-90f1-4490-89d3-7cf63668f8fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:41.819852 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55a1b082-90f1-4490-89d3-7cf63668f8fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:41.820933 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55a1b082-90f1-4490-89d3-7cf63668f8fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:41.823279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55a1b082-90f1-4490-89d3-7cf63668f8fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:41.824747 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55a1b082-90f1-4490-89d3-7cf63668f8fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:41.825468 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55a1b082-90f1-4490-89d3-7cf63668f8fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:41.828426 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55a1b082-90f1-4490-89d3-7cf63668f8fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:42.085155 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-094839a0-9ccb-4e98-8b3e-e8a6301de1f0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:42.109765 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-094839a0-9ccb-4e98-8b3e-e8a6301de1f0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.341099 Aug 29 19:02:42.118808 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 73/158] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:41 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:42.125816 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cf092c4d-466d-4ba4-8f77-36be5ffe93c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:42.127029 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cf092c4d-466d-4ba4-8f77-36be5ffe93c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:42.143783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf092c4d-466d-4ba4-8f77-36be5ffe93c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:42.144278 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf092c4d-466d-4ba4-8f77-36be5ffe93c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:42.145400 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf092c4d-466d-4ba4-8f77-36be5ffe93c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:42.146115 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf092c4d-466d-4ba4-8f77-36be5ffe93c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:42.147880 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf092c4d-466d-4ba4-8f77-36be5ffe93c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:42.149935 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf092c4d-466d-4ba4-8f77-36be5ffe93c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:42.217525 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-55a1b082-90f1-4490-89d3-7cf63668f8fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:42.226076 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-55a1b082-90f1-4490-89d3-7cf63668f8fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.430709 Aug 29 19:02:42.226651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 86/159] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:41 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:42.242200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-11724a0b-1d3e-4442-a452-1331962e7c1b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:42.243654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-11724a0b-1d3e-4442-a452-1331962e7c1b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:42.259238 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11724a0b-1d3e-4442-a452-1331962e7c1b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:42.259747 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11724a0b-1d3e-4442-a452-1331962e7c1b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:42.260174 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11724a0b-1d3e-4442-a452-1331962e7c1b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:42.262196 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11724a0b-1d3e-4442-a452-1331962e7c1b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:42.264990 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11724a0b-1d3e-4442-a452-1331962e7c1b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:42.265712 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11724a0b-1d3e-4442-a452-1331962e7c1b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:42.413210 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cf092c4d-466d-4ba4-8f77-36be5ffe93c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:42.428885 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cf092c4d-466d-4ba4-8f77-36be5ffe93c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:42.432620 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cf092c4d-466d-4ba4-8f77-36be5ffe93c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:42.435034 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cf092c4d-466d-4ba4-8f77-36be5ffe93c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.314272 Aug 29 19:02:42.435617 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 74/160] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:42 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:42.521673 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-11724a0b-1d3e-4442-a452-1331962e7c1b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:42.531171 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-11724a0b-1d3e-4442-a452-1331962e7c1b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.294753 Aug 29 19:02:42.531918 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 87/161] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:42 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:43.134186 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c60e5a22-345f-497d-b96e-8bb7f93cb1c3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:43.136687 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c60e5a22-345f-497d-b96e-8bb7f93cb1c3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:43.148127 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c60e5a22-345f-497d-b96e-8bb7f93cb1c3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:43.148956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c60e5a22-345f-497d-b96e-8bb7f93cb1c3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:43.149577 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c60e5a22-345f-497d-b96e-8bb7f93cb1c3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:43.150487 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c60e5a22-345f-497d-b96e-8bb7f93cb1c3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:43.151158 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c60e5a22-345f-497d-b96e-8bb7f93cb1c3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:43.151804 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c60e5a22-345f-497d-b96e-8bb7f93cb1c3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:43.259449 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fe67a78f-379c-4898-b44d-59df2ce4a838 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:43.261272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fe67a78f-379c-4898-b44d-59df2ce4a838 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:43.278913 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe67a78f-379c-4898-b44d-59df2ce4a838 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:43.280670 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe67a78f-379c-4898-b44d-59df2ce4a838 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:43.282852 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe67a78f-379c-4898-b44d-59df2ce4a838 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:43.284756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe67a78f-379c-4898-b44d-59df2ce4a838 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:43.289558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe67a78f-379c-4898-b44d-59df2ce4a838 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:43.290012 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe67a78f-379c-4898-b44d-59df2ce4a838 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:43.368977 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c60e5a22-345f-497d-b96e-8bb7f93cb1c3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:43.377801 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c60e5a22-345f-497d-b96e-8bb7f93cb1c3 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.250377 Aug 29 19:02:43.378577 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 75/162] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:43 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:43.465232 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fe67a78f-379c-4898-b44d-59df2ce4a838 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:43.469894 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c66a5568-9df5-4717-8a19-a5446c108291 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:43.470909 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c66a5568-9df5-4717-8a19-a5446c108291 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:43.476427 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fe67a78f-379c-4898-b44d-59df2ce4a838 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.231013 Aug 29 19:02:43.479081 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c66a5568-9df5-4717-8a19-a5446c108291 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:43.479806 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c66a5568-9df5-4717-8a19-a5446c108291 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:43.480614 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c66a5568-9df5-4717-8a19-a5446c108291 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:43.481523 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c66a5568-9df5-4717-8a19-a5446c108291 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:43.482179 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c66a5568-9df5-4717-8a19-a5446c108291 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:43.482803 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c66a5568-9df5-4717-8a19-a5446c108291 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:43.488659 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 88/163] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:43 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:43.557476 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-61975aa6-9ab1-48c0-bf43-ab914d632096 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:43.558223 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-61975aa6-9ab1-48c0-bf43-ab914d632096 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:43.574309 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61975aa6-9ab1-48c0-bf43-ab914d632096 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:43.574803 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61975aa6-9ab1-48c0-bf43-ab914d632096 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:43.575329 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61975aa6-9ab1-48c0-bf43-ab914d632096 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:43.576034 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61975aa6-9ab1-48c0-bf43-ab914d632096 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:43.576484 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61975aa6-9ab1-48c0-bf43-ab914d632096 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:43.576931 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61975aa6-9ab1-48c0-bf43-ab914d632096 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:43.798797 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-61975aa6-9ab1-48c0-bf43-ab914d632096 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:43.808565 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c66a5568-9df5-4717-8a19-a5446c108291 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:43.816450 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-61975aa6-9ab1-48c0-bf43-ab914d632096 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.263225 Aug 29 19:02:43.817020 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 89/164] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:43 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:43.822865 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c66a5568-9df5-4717-8a19-a5446c108291 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:43.824978 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c66a5568-9df5-4717-8a19-a5446c108291 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:43.826114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c66a5568-9df5-4717-8a19-a5446c108291 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.361194 Aug 29 19:02:43.826891 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 76/165] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:43 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:44.402814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-31e2ce9c-4a34-4137-9783-4cb42ce323a6 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:44.405836 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-31e2ce9c-4a34-4137-9783-4cb42ce323a6 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:44.416337 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31e2ce9c-4a34-4137-9783-4cb42ce323a6 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:44.417156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31e2ce9c-4a34-4137-9783-4cb42ce323a6 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:44.418254 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31e2ce9c-4a34-4137-9783-4cb42ce323a6 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:44.421078 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31e2ce9c-4a34-4137-9783-4cb42ce323a6 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:44.421931 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31e2ce9c-4a34-4137-9783-4cb42ce323a6 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:44.422652 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31e2ce9c-4a34-4137-9783-4cb42ce323a6 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:44.498250 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f572fa12-dbc7-440b-8396-e2fdde6d9f81 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:44.501057 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f572fa12-dbc7-440b-8396-e2fdde6d9f81 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:44.508274 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f572fa12-dbc7-440b-8396-e2fdde6d9f81 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:44.509979 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f572fa12-dbc7-440b-8396-e2fdde6d9f81 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:44.510645 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f572fa12-dbc7-440b-8396-e2fdde6d9f81 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:44.511606 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f572fa12-dbc7-440b-8396-e2fdde6d9f81 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:44.512296 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f572fa12-dbc7-440b-8396-e2fdde6d9f81 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:44.512929 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f572fa12-dbc7-440b-8396-e2fdde6d9f81 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:44.612186 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-31e2ce9c-4a34-4137-9783-4cb42ce323a6 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:44.620482 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-31e2ce9c-4a34-4137-9783-4cb42ce323a6 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1315 microversion: 2.1 time: 0.224872 Aug 29 19:02:44.623326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 90/166] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:44 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:44.714214 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-2399961e-5666-46bc-90bc-983221d84abb req-48577ee2-d60f-435d-b224-eed826487abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55705ba3-2981-43e1-80e0-29995ee472a9", "name": "network-vif-plugged", "status": "completed", "tag": "e7223967-a4dc-4ee2-8b85-82a153b42231"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:02:44.731964 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=99 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:44.750150 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-2399961e-5666-46bc-90bc-983221d84abb req-48577ee2-d60f-435d-b224-eed826487abe service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:44.751269 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-2399961e-5666-46bc-90bc-983221d84abb req-48577ee2-d60f-435d-b224-eed826487abe service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:44.752755 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-2399961e-5666-46bc-90bc-983221d84abb req-48577ee2-d60f-435d-b224-eed826487abe service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:44.769313 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f572fa12-dbc7-440b-8396-e2fdde6d9f81 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:44.775931 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-2399961e-5666-46bc-90bc-983221d84abb req-48577ee2-d60f-435d-b224-eed826487abe service nova] Creating event network-vif-plugged:e7223967-a4dc-4ee2-8b85-82a153b42231 for instance 55705ba3-2981-43e1-80e0-29995ee472a9 on hv-cinder-85083 Aug 29 19:02:44.783918 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-2399961e-5666-46bc-90bc-983221d84abb req-48577ee2-d60f-435d-b224-eed826487abe service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083052 Aug 29 19:02:44.784868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 91/167] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:02:44.803268 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f572fa12-dbc7-440b-8396-e2fdde6d9f81 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.308641 Aug 29 19:02:44.806602 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 77/168] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:44 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:44.849246 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-07955891-daa9-4d2e-8b70-717e53c3ec31 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:44.849963 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2ca7809c-4812-4105-a40d-27ec30e5c4c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:44.850080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-07955891-daa9-4d2e-8b70-717e53c3ec31 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:44.851247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2ca7809c-4812-4105-a40d-27ec30e5c4c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:44.857859 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ca7809c-4812-4105-a40d-27ec30e5c4c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:44.859295 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ca7809c-4812-4105-a40d-27ec30e5c4c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:44.859908 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ca7809c-4812-4105-a40d-27ec30e5c4c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:44.862179 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ca7809c-4812-4105-a40d-27ec30e5c4c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:44.863634 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ca7809c-4812-4105-a40d-27ec30e5c4c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:44.864558 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ca7809c-4812-4105-a40d-27ec30e5c4c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:44.870598 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-07955891-daa9-4d2e-8b70-717e53c3ec31 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:44.871147 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-07955891-daa9-4d2e-8b70-717e53c3ec31 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:44.871587 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-07955891-daa9-4d2e-8b70-717e53c3ec31 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:44.883103 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-07955891-daa9-4d2e-8b70-717e53c3ec31 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:44.883610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-07955891-daa9-4d2e-8b70-717e53c3ec31 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:44.886620 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-07955891-daa9-4d2e-8b70-717e53c3ec31 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:45.206598 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-07955891-daa9-4d2e-8b70-717e53c3ec31 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:45.218123 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-07955891-daa9-4d2e-8b70-717e53c3ec31 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.383616 Aug 29 19:02:45.227373 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2ca7809c-4812-4105-a40d-27ec30e5c4c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:45.231975 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 92/169] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:44 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:45.241856 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2ca7809c-4812-4105-a40d-27ec30e5c4c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:45.245150 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2ca7809c-4812-4105-a40d-27ec30e5c4c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:45.246326 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2ca7809c-4812-4105-a40d-27ec30e5c4c7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.401733 Aug 29 19:02:45.262043 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 78/170] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:44 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:02:45.643682 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-33dc9c2b-f6d7-4a6f-ae7a-5864b36d9970 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:45.644337 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-33dc9c2b-f6d7-4a6f-ae7a-5864b36d9970 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:45.652905 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33dc9c2b-f6d7-4a6f-ae7a-5864b36d9970 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:45.654519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33dc9c2b-f6d7-4a6f-ae7a-5864b36d9970 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:45.655636 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33dc9c2b-f6d7-4a6f-ae7a-5864b36d9970 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:45.656551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33dc9c2b-f6d7-4a6f-ae7a-5864b36d9970 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:45.657600 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33dc9c2b-f6d7-4a6f-ae7a-5864b36d9970 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:45.658213 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33dc9c2b-f6d7-4a6f-ae7a-5864b36d9970 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:45.829847 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8370be04-7245-45c2-9715-774c67d6c995 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:45.830464 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8370be04-7245-45c2-9715-774c67d6c995 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:45.842043 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8370be04-7245-45c2-9715-774c67d6c995 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:45.842573 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8370be04-7245-45c2-9715-774c67d6c995 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:45.846424 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8370be04-7245-45c2-9715-774c67d6c995 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:45.847446 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8370be04-7245-45c2-9715-774c67d6c995 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:45.849965 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8370be04-7245-45c2-9715-774c67d6c995 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:45.850617 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8370be04-7245-45c2-9715-774c67d6c995 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:46.002657 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-33dc9c2b-f6d7-4a6f-ae7a-5864b36d9970 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:46.011013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-33dc9c2b-f6d7-4a6f-ae7a-5864b36d9970 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1502 microversion: 2.1 time: 0.372759 Aug 29 19:02:46.011831 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 93/171] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:45 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1502 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:46.096365 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8370be04-7245-45c2-9715-774c67d6c995 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:46.104880 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8370be04-7245-45c2-9715-774c67d6c995 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.278793 Aug 29 19:02:46.105340 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 79/172] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:45 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:46.240312 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7d8b9718-5acd-4986-8224-fe1aeaea54c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:46.240814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7d8b9718-5acd-4986-8224-fe1aeaea54c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:46.247052 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d8b9718-5acd-4986-8224-fe1aeaea54c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:46.247545 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d8b9718-5acd-4986-8224-fe1aeaea54c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:46.247979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d8b9718-5acd-4986-8224-fe1aeaea54c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:46.248714 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d8b9718-5acd-4986-8224-fe1aeaea54c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:46.249156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d8b9718-5acd-4986-8224-fe1aeaea54c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:46.249578 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d8b9718-5acd-4986-8224-fe1aeaea54c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:46.276400 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-72880298-4036-428a-a970-ac7d7346dc98 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:46.277333 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-72880298-4036-428a-a970-ac7d7346dc98 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:46.287785 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=96 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:46.290825 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72880298-4036-428a-a970-ac7d7346dc98 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:46.292780 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72880298-4036-428a-a970-ac7d7346dc98 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:46.293374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72880298-4036-428a-a970-ac7d7346dc98 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:46.294899 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72880298-4036-428a-a970-ac7d7346dc98 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:46.296194 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72880298-4036-428a-a970-ac7d7346dc98 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:46.297313 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72880298-4036-428a-a970-ac7d7346dc98 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:46.594863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7d8b9718-5acd-4986-8224-fe1aeaea54c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:46.616081 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7d8b9718-5acd-4986-8224-fe1aeaea54c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.379740 Aug 29 19:02:46.616691 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 94/173] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:46 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:46.687575 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-72880298-4036-428a-a970-ac7d7346dc98 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:46.701671 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-72880298-4036-428a-a970-ac7d7346dc98 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:46.708877 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-72880298-4036-428a-a970-ac7d7346dc98 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:46.710054 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-72880298-4036-428a-a970-ac7d7346dc98 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.440985 Aug 29 19:02:46.713112 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 80/174] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:46 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:46.829129 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-61ed68e3-82b1-43f7-8b72-d1e033edca47 req-c9693f32-abe8-49a3-94c7-b9414f818eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01f30bf-2698-4cae-a884-141ce3b7862a", "name": "network-vif-plugged", "status": "completed", "tag": "44e52739-3f46-4693-a6b5-905096ce7217"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:02:46.864607 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-61ed68e3-82b1-43f7-8b72-d1e033edca47 req-c9693f32-abe8-49a3-94c7-b9414f818eac service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:46.873482 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-61ed68e3-82b1-43f7-8b72-d1e033edca47 req-c9693f32-abe8-49a3-94c7-b9414f818eac service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:46.874745 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-61ed68e3-82b1-43f7-8b72-d1e033edca47 req-c9693f32-abe8-49a3-94c7-b9414f818eac service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:46.887374 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-61ed68e3-82b1-43f7-8b72-d1e033edca47 req-c9693f32-abe8-49a3-94c7-b9414f818eac service nova] Creating event network-vif-plugged:44e52739-3f46-4693-a6b5-905096ce7217 for instance c01f30bf-2698-4cae-a884-141ce3b7862a on hv-cinder-85083 Aug 29 19:02:46.894026 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-61ed68e3-82b1-43f7-8b72-d1e033edca47 req-c9693f32-abe8-49a3-94c7-b9414f818eac service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069790 Aug 29 19:02:46.895441 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 95/175] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:02:47.127786 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ddebf2ab-f339-45fc-85a6-f9b82ccccd10 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:47.129043 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ddebf2ab-f339-45fc-85a6-f9b82ccccd10 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:47.135770 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ddebf2ab-f339-45fc-85a6-f9b82ccccd10 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:47.136807 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ddebf2ab-f339-45fc-85a6-f9b82ccccd10 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:47.137614 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ddebf2ab-f339-45fc-85a6-f9b82ccccd10 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:47.143901 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ddebf2ab-f339-45fc-85a6-f9b82ccccd10 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:47.144647 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ddebf2ab-f339-45fc-85a6-f9b82ccccd10 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:47.145306 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ddebf2ab-f339-45fc-85a6-f9b82ccccd10 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:47.330371 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ddebf2ab-f339-45fc-85a6-f9b82ccccd10 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:47.339960 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ddebf2ab-f339-45fc-85a6-f9b82ccccd10 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.217236 Aug 29 19:02:47.347094 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 81/176] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:47 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:47.513971 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-608e0cbd-f48b-43be-9890-751db81af419 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f32e48a-d1f8-4928-b51e-fc03c055ffaa"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:02:47.516739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-608e0cbd-f48b-43be-9890-751db81af419 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:47.528561 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-608e0cbd-f48b-43be-9890-751db81af419 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:47.533647 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-608e0cbd-f48b-43be-9890-751db81af419 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:47.534454 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-608e0cbd-f48b-43be-9890-751db81af419 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:47.535398 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-608e0cbd-f48b-43be-9890-751db81af419 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:47.536176 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-608e0cbd-f48b-43be-9890-751db81af419 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:47.536797 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-608e0cbd-f48b-43be-9890-751db81af419 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:47.639083 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-44a6239a-6257-4674-98f1-9ef95f3f56c9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:47.641006 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-44a6239a-6257-4674-98f1-9ef95f3f56c9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:47.656194 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44a6239a-6257-4674-98f1-9ef95f3f56c9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:47.656690 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44a6239a-6257-4674-98f1-9ef95f3f56c9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:47.657125 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44a6239a-6257-4674-98f1-9ef95f3f56c9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:47.657823 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44a6239a-6257-4674-98f1-9ef95f3f56c9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:47.658267 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44a6239a-6257-4674-98f1-9ef95f3f56c9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:47.659058 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44a6239a-6257-4674-98f1-9ef95f3f56c9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:47.834574 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-44a6239a-6257-4674-98f1-9ef95f3f56c9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:47.843686 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-44a6239a-6257-4674-98f1-9ef95f3f56c9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.209423 Aug 29 19:02:47.855121 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 82/177] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:47 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:47.862032 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-62c7df30-ca6d-4d85-8057-e533ee5cd3f5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:47.862757 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-62c7df30-ca6d-4d85-8057-e533ee5cd3f5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:47.873210 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62c7df30-ca6d-4d85-8057-e533ee5cd3f5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:47.874353 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62c7df30-ca6d-4d85-8057-e533ee5cd3f5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:47.875030 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62c7df30-ca6d-4d85-8057-e533ee5cd3f5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:47.884471 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62c7df30-ca6d-4d85-8057-e533ee5cd3f5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:47.890201 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62c7df30-ca6d-4d85-8057-e533ee5cd3f5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:47.890681 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62c7df30-ca6d-4d85-8057-e533ee5cd3f5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:47.895694 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:48.118625 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-62c7df30-ca6d-4d85-8057-e533ee5cd3f5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:48.127217 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-62c7df30-ca6d-4d85-8057-e533ee5cd3f5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:48.129133 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-62c7df30-ca6d-4d85-8057-e533ee5cd3f5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:48.130543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-62c7df30-ca6d-4d85-8057-e533ee5cd3f5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.284634 Aug 29 19:02:48.131669 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 83/178] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:47 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:48.361537 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-489becb1-0ad8-4f3c-9dff-6800601e80a5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:48.362139 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-489becb1-0ad8-4f3c-9dff-6800601e80a5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:48.368013 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-489becb1-0ad8-4f3c-9dff-6800601e80a5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:48.368528 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-489becb1-0ad8-4f3c-9dff-6800601e80a5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:48.368941 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-489becb1-0ad8-4f3c-9dff-6800601e80a5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:48.369605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-489becb1-0ad8-4f3c-9dff-6800601e80a5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:48.370046 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-489becb1-0ad8-4f3c-9dff-6800601e80a5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:48.370456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-489becb1-0ad8-4f3c-9dff-6800601e80a5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:48.496962 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-489becb1-0ad8-4f3c-9dff-6800601e80a5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:48.505348 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-489becb1-0ad8-4f3c-9dff-6800601e80a5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.147821 Aug 29 19:02:48.505925 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 84/179] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:48 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:48.866493 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-63a4c14e-96d3-4dfa-a281-e87967598524 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:48.867123 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-63a4c14e-96d3-4dfa-a281-e87967598524 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:48.873030 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-63a4c14e-96d3-4dfa-a281-e87967598524 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:48.874054 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-63a4c14e-96d3-4dfa-a281-e87967598524 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:48.874575 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-63a4c14e-96d3-4dfa-a281-e87967598524 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:48.875275 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-63a4c14e-96d3-4dfa-a281-e87967598524 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:48.875726 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-63a4c14e-96d3-4dfa-a281-e87967598524 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:48.876147 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-63a4c14e-96d3-4dfa-a281-e87967598524 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:49.004520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-63a4c14e-96d3-4dfa-a281-e87967598524 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:49.012079 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-63a4c14e-96d3-4dfa-a281-e87967598524 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.149454 Aug 29 19:02:49.012650 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 85/180] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:48 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:49.157099 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c9f7be5f-5fea-4a5d-b17f-203616290864 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:49.157736 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c9f7be5f-5fea-4a5d-b17f-203616290864 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:49.163680 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9f7be5f-5fea-4a5d-b17f-203616290864 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:49.164166 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9f7be5f-5fea-4a5d-b17f-203616290864 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:49.164598 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9f7be5f-5fea-4a5d-b17f-203616290864 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:49.165278 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9f7be5f-5fea-4a5d-b17f-203616290864 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:49.165731 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9f7be5f-5fea-4a5d-b17f-203616290864 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:49.166151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9f7be5f-5fea-4a5d-b17f-203616290864 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:49.290961 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c9f7be5f-5fea-4a5d-b17f-203616290864 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:49.299284 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c9f7be5f-5fea-4a5d-b17f-203616290864 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:49.300736 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c9f7be5f-5fea-4a5d-b17f-203616290864 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:49.301831 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c9f7be5f-5fea-4a5d-b17f-203616290864 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.148696 Aug 29 19:02:49.302393 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 86/181] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:49 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:02:49.525624 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0a90ec90-92fa-4603-98b7-5e83d20f8978 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:49.526228 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0a90ec90-92fa-4603-98b7-5e83d20f8978 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:49.532328 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a90ec90-92fa-4603-98b7-5e83d20f8978 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:49.532799 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a90ec90-92fa-4603-98b7-5e83d20f8978 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:49.533238 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a90ec90-92fa-4603-98b7-5e83d20f8978 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:49.533981 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a90ec90-92fa-4603-98b7-5e83d20f8978 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:49.534529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a90ec90-92fa-4603-98b7-5e83d20f8978 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:49.534944 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a90ec90-92fa-4603-98b7-5e83d20f8978 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:49.664067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0a90ec90-92fa-4603-98b7-5e83d20f8978 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:49.672084 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0a90ec90-92fa-4603-98b7-5e83d20f8978 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.150251 Aug 29 19:02:49.672644 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 87/182] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:49 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:50.033881 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-467c9a6c-a38c-42e8-ab71-8cc073c038b3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:50.034490 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-467c9a6c-a38c-42e8-ab71-8cc073c038b3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:50.040451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-467c9a6c-a38c-42e8-ab71-8cc073c038b3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:50.040930 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-467c9a6c-a38c-42e8-ab71-8cc073c038b3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:50.041363 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-467c9a6c-a38c-42e8-ab71-8cc073c038b3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:50.042038 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-467c9a6c-a38c-42e8-ab71-8cc073c038b3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:50.042488 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-467c9a6c-a38c-42e8-ab71-8cc073c038b3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:50.042904 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-467c9a6c-a38c-42e8-ab71-8cc073c038b3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:50.198437 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-467c9a6c-a38c-42e8-ab71-8cc073c038b3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:50.206545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-467c9a6c-a38c-42e8-ab71-8cc073c038b3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.177071 Aug 29 19:02:50.207191 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 88/183] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:50 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:50.324500 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f368abeb-1e1b-48c5-8700-6b756231bf82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:50.325029 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f368abeb-1e1b-48c5-8700-6b756231bf82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:50.331335 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f368abeb-1e1b-48c5-8700-6b756231bf82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:50.331816 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f368abeb-1e1b-48c5-8700-6b756231bf82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:50.332242 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f368abeb-1e1b-48c5-8700-6b756231bf82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:50.332916 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f368abeb-1e1b-48c5-8700-6b756231bf82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:50.333361 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f368abeb-1e1b-48c5-8700-6b756231bf82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:50.333778 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f368abeb-1e1b-48c5-8700-6b756231bf82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:50.459302 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f368abeb-1e1b-48c5-8700-6b756231bf82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:50.467772 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f368abeb-1e1b-48c5-8700-6b756231bf82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:50.469324 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f368abeb-1e1b-48c5-8700-6b756231bf82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:50.470407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f368abeb-1e1b-48c5-8700-6b756231bf82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.149773 Aug 29 19:02:50.470955 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 89/184] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:50 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:02:50.698348 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-84108ea0-e7bf-44ad-8cd9-faf474c49ea8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:50.699662 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-84108ea0-e7bf-44ad-8cd9-faf474c49ea8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:50.706339 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-84108ea0-e7bf-44ad-8cd9-faf474c49ea8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:50.706826 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-84108ea0-e7bf-44ad-8cd9-faf474c49ea8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:50.707300 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-84108ea0-e7bf-44ad-8cd9-faf474c49ea8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:50.707986 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-84108ea0-e7bf-44ad-8cd9-faf474c49ea8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:50.708434 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-84108ea0-e7bf-44ad-8cd9-faf474c49ea8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:50.708850 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-84108ea0-e7bf-44ad-8cd9-faf474c49ea8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:50.844172 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-84108ea0-e7bf-44ad-8cd9-faf474c49ea8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:50.851576 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-84108ea0-e7bf-44ad-8cd9-faf474c49ea8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.162054 Aug 29 19:02:50.852138 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 90/185] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:50 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:51.227763 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e67fd0f4-a736-4844-a393-6db63a5dd962 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:51.228423 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e67fd0f4-a736-4844-a393-6db63a5dd962 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:51.235438 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e67fd0f4-a736-4844-a393-6db63a5dd962 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:51.236114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e67fd0f4-a736-4844-a393-6db63a5dd962 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:51.236705 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e67fd0f4-a736-4844-a393-6db63a5dd962 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:51.237542 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e67fd0f4-a736-4844-a393-6db63a5dd962 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:51.238134 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e67fd0f4-a736-4844-a393-6db63a5dd962 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:51.238696 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e67fd0f4-a736-4844-a393-6db63a5dd962 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:51.373233 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e67fd0f4-a736-4844-a393-6db63a5dd962 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:51.389023 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e67fd0f4-a736-4844-a393-6db63a5dd962 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.165338 Aug 29 19:02:51.389606 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 91/186] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:51 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:51.492257 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0aa618c5-8bb3-49e8-8fc4-2be04a0ae227 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:51.492783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0aa618c5-8bb3-49e8-8fc4-2be04a0ae227 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:51.498628 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0aa618c5-8bb3-49e8-8fc4-2be04a0ae227 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:51.499153 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0aa618c5-8bb3-49e8-8fc4-2be04a0ae227 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:51.499577 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0aa618c5-8bb3-49e8-8fc4-2be04a0ae227 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:51.500246 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0aa618c5-8bb3-49e8-8fc4-2be04a0ae227 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:51.500689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0aa618c5-8bb3-49e8-8fc4-2be04a0ae227 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:51.501100 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0aa618c5-8bb3-49e8-8fc4-2be04a0ae227 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:51.632367 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0aa618c5-8bb3-49e8-8fc4-2be04a0ae227 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:51.640849 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0aa618c5-8bb3-49e8-8fc4-2be04a0ae227 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:51.642291 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0aa618c5-8bb3-49e8-8fc4-2be04a0ae227 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:51.643408 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0aa618c5-8bb3-49e8-8fc4-2be04a0ae227 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.155157 Aug 29 19:02:51.643965 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 92/187] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:51 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:02:51.872607 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-df5e5498-6780-42cf-b9ff-a06b0b8b95d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:51.873214 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-df5e5498-6780-42cf-b9ff-a06b0b8b95d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:51.879135 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df5e5498-6780-42cf-b9ff-a06b0b8b95d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:51.879617 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df5e5498-6780-42cf-b9ff-a06b0b8b95d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:51.880046 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df5e5498-6780-42cf-b9ff-a06b0b8b95d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:51.880726 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df5e5498-6780-42cf-b9ff-a06b0b8b95d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:51.881173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df5e5498-6780-42cf-b9ff-a06b0b8b95d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:51.881595 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df5e5498-6780-42cf-b9ff-a06b0b8b95d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:52.008775 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-df5e5498-6780-42cf-b9ff-a06b0b8b95d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:52.016840 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-df5e5498-6780-42cf-b9ff-a06b0b8b95d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.148155 Aug 29 19:02:52.017391 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 93/188] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:51 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:52.409865 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1a118176-7deb-44bf-8e8c-a7f68d1efc3e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:52.410538 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1a118176-7deb-44bf-8e8c-a7f68d1efc3e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:52.416603 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a118176-7deb-44bf-8e8c-a7f68d1efc3e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:52.417095 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a118176-7deb-44bf-8e8c-a7f68d1efc3e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:52.417538 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a118176-7deb-44bf-8e8c-a7f68d1efc3e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:52.418235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a118176-7deb-44bf-8e8c-a7f68d1efc3e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:52.418684 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a118176-7deb-44bf-8e8c-a7f68d1efc3e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:52.419135 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a118176-7deb-44bf-8e8c-a7f68d1efc3e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:52.551762 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1a118176-7deb-44bf-8e8c-a7f68d1efc3e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:52.559429 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1a118176-7deb-44bf-8e8c-a7f68d1efc3e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1363 microversion: 2.1 time: 0.153471 Aug 29 19:02:52.559998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 94/189] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:52 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:52.665835 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-48efd62f-2a48-4e8d-b4f6-07606464ce5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:52.666467 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-48efd62f-2a48-4e8d-b4f6-07606464ce5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:52.672837 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48efd62f-2a48-4e8d-b4f6-07606464ce5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:52.673312 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48efd62f-2a48-4e8d-b4f6-07606464ce5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:52.673739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48efd62f-2a48-4e8d-b4f6-07606464ce5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:52.674413 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48efd62f-2a48-4e8d-b4f6-07606464ce5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:52.674864 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48efd62f-2a48-4e8d-b4f6-07606464ce5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:52.675330 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48efd62f-2a48-4e8d-b4f6-07606464ce5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:52.806211 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-48efd62f-2a48-4e8d-b4f6-07606464ce5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:52.814288 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-48efd62f-2a48-4e8d-b4f6-07606464ce5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:52.815796 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-48efd62f-2a48-4e8d-b4f6-07606464ce5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:52.816899 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-48efd62f-2a48-4e8d-b4f6-07606464ce5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1407 microversion: 2.20 time: 0.154901 Aug 29 19:02:52.817452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 95/190] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:52 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:02:53.037396 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2eb88eca-9954-42d8-a7ca-6250fa39724f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:53.038001 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2eb88eca-9954-42d8-a7ca-6250fa39724f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:53.043904 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eb88eca-9954-42d8-a7ca-6250fa39724f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:53.044383 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eb88eca-9954-42d8-a7ca-6250fa39724f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:53.044812 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eb88eca-9954-42d8-a7ca-6250fa39724f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:53.046079 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eb88eca-9954-42d8-a7ca-6250fa39724f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:53.046530 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eb88eca-9954-42d8-a7ca-6250fa39724f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:53.047014 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eb88eca-9954-42d8-a7ca-6250fa39724f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:53.173987 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2eb88eca-9954-42d8-a7ca-6250fa39724f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:53.181585 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2eb88eca-9954-42d8-a7ca-6250fa39724f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.148091 Aug 29 19:02:53.182148 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 96/191] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:53 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:53.548227 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-105374528", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452", "networks": [{"uuid": "44f8d360-5ca3-4012-b017-b14c9f8ccbad"}]}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:02:53.601929 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] validate_networks() for [('44f8d360-5ca3-4012-b017-b14c9f8ccbad', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:02:53.951619 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:02:53.952158 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:02:53.952797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:02:53.953212 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:02:53.953720 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:02:53.963600 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:53.964076 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:53.964504 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:53.965228 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:53.965676 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:53.966709 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:53.984055 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Getting quotas for project cbf40ccacdc74575909f541214adf6f7. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:02:53.987988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Getting quotas for user 41227378a57c43219e4ae460c642f834 and project cbf40ccacdc74575909f541214adf6f7. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:02:53.999433 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:02:54.001693 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:02:54.046595 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d60f4748-f3d4-49a8-8f08-5b1609c420c9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503299 Aug 29 19:02:54.047264 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 97/192] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:02:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 19:02:54.055067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-16d26809-e852-4d72-b6f8-0f45ca5d7605 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:54.055750 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-16d26809-e852-4d72-b6f8-0f45ca5d7605 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:54.062888 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16d26809-e852-4d72-b6f8-0f45ca5d7605 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:54.063393 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16d26809-e852-4d72-b6f8-0f45ca5d7605 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:54.063832 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16d26809-e852-4d72-b6f8-0f45ca5d7605 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:54.064538 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16d26809-e852-4d72-b6f8-0f45ca5d7605 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:54.064992 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16d26809-e852-4d72-b6f8-0f45ca5d7605 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:54.065414 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16d26809-e852-4d72-b6f8-0f45ca5d7605 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:54.204459 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-16d26809-e852-4d72-b6f8-0f45ca5d7605 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:54.212373 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-16d26809-e852-4d72-b6f8-0f45ca5d7605 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1548 microversion: 2.1 time: 0.161074 Aug 29 19:02:54.212935 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 98/193] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:54 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:54.217845 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1ca4b927-9870-47cb-97ae-9b89c535137a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:54.218440 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1ca4b927-9870-47cb-97ae-9b89c535137a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:54.224344 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ca4b927-9870-47cb-97ae-9b89c535137a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:54.224826 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ca4b927-9870-47cb-97ae-9b89c535137a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:54.225397 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ca4b927-9870-47cb-97ae-9b89c535137a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:54.226085 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ca4b927-9870-47cb-97ae-9b89c535137a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:54.226536 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ca4b927-9870-47cb-97ae-9b89c535137a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:54.226985 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ca4b927-9870-47cb-97ae-9b89c535137a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:54.387235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1ca4b927-9870-47cb-97ae-9b89c535137a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:54.409192 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1ca4b927-9870-47cb-97ae-9b89c535137a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:54.411786 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1ca4b927-9870-47cb-97ae-9b89c535137a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:54.413008 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1ca4b927-9870-47cb-97ae-9b89c535137a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1598 microversion: 2.20 time: 0.199113 Aug 29 19:02:54.413793 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 99/194] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:02:54 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1598 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:54.430660 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-06592266-010c-4a69-863a-4079ac2b5e13 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:54.431706 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-06592266-010c-4a69-863a-4079ac2b5e13 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:54.488383 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-06592266-010c-4a69-863a-4079ac2b5e13 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:54.495532 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-06592266-010c-4a69-863a-4079ac2b5e13 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1213 microversion: 2.1 time: 0.079453 Aug 29 19:02:54.496085 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 100/195] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:54 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:54.500515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-29751e4a-6b63-4784-ba69-f5c21bc5a44a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:54.501159 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-29751e4a-6b63-4784-ba69-f5c21bc5a44a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:54.507046 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-29751e4a-6b63-4784-ba69-f5c21bc5a44a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:54.507536 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-29751e4a-6b63-4784-ba69-f5c21bc5a44a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:54.507968 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-29751e4a-6b63-4784-ba69-f5c21bc5a44a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:54.509250 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-29751e4a-6b63-4784-ba69-f5c21bc5a44a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:54.509250 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-29751e4a-6b63-4784-ba69-f5c21bc5a44a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:54.509557 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-29751e4a-6b63-4784-ba69-f5c21bc5a44a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:54.524844 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:54.652361 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-29751e4a-6b63-4784-ba69-f5c21bc5a44a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:54.660555 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-29751e4a-6b63-4784-ba69-f5c21bc5a44a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.163546 Aug 29 19:02:54.661113 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 101/196] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:54 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:54.665522 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-924523ca-65f1-4a4f-8565-84731f594b0d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:54.666013 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-924523ca-65f1-4a4f-8565-84731f594b0d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:54.671701 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-924523ca-65f1-4a4f-8565-84731f594b0d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:54.672189 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-924523ca-65f1-4a4f-8565-84731f594b0d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:54.672618 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-924523ca-65f1-4a4f-8565-84731f594b0d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:54.673296 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-924523ca-65f1-4a4f-8565-84731f594b0d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:54.673745 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-924523ca-65f1-4a4f-8565-84731f594b0d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:54.674164 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-924523ca-65f1-4a4f-8565-84731f594b0d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:54.789541 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-924523ca-65f1-4a4f-8565-84731f594b0d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127325 Aug 29 19:02:54.790136 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 102/197] 10.222.0.86 () {58 vars in 1275 bytes} [Mon Aug 29 19:02:54 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:02:54.794798 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b3eda4c3-7b1f-4e2a-905c-1ba4c731ca01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:54.795367 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b3eda4c3-7b1f-4e2a-905c-1ba4c731ca01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:54.801343 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3eda4c3-7b1f-4e2a-905c-1ba4c731ca01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:54.801823 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3eda4c3-7b1f-4e2a-905c-1ba4c731ca01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:54.802257 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3eda4c3-7b1f-4e2a-905c-1ba4c731ca01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:54.802939 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3eda4c3-7b1f-4e2a-905c-1ba4c731ca01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:54.803417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3eda4c3-7b1f-4e2a-905c-1ba4c731ca01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:54.803861 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3eda4c3-7b1f-4e2a-905c-1ba4c731ca01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:54.879223 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b3eda4c3-7b1f-4e2a-905c-1ba4c731ca01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087953 Aug 29 19:02:54.879825 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 103/198] 10.222.0.86 () {60 vars in 1316 bytes} [Mon Aug 29 19:02:54 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:02:55.516504 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-08b107b5-c9eb-4b5d-a2f1-b9d15f58c657 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:55.517374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-08b107b5-c9eb-4b5d-a2f1-b9d15f58c657 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:55.523448 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08b107b5-c9eb-4b5d-a2f1-b9d15f58c657 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:55.523976 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08b107b5-c9eb-4b5d-a2f1-b9d15f58c657 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:55.524522 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08b107b5-c9eb-4b5d-a2f1-b9d15f58c657 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:55.525301 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08b107b5-c9eb-4b5d-a2f1-b9d15f58c657 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:55.525843 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08b107b5-c9eb-4b5d-a2f1-b9d15f58c657 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:55.526384 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08b107b5-c9eb-4b5d-a2f1-b9d15f58c657 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:55.644674 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-08b107b5-c9eb-4b5d-a2f1-b9d15f58c657 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:55.653426 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-08b107b5-c9eb-4b5d-a2f1-b9d15f58c657 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1217 microversion: 2.1 time: 0.141210 Aug 29 19:02:55.655389 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 104/199] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:55 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:55.681329 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-35a74ac0-1e6b-446e-9493-95bcea2b3569 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:55.681813 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-35a74ac0-1e6b-446e-9493-95bcea2b3569 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:55.688522 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-35a74ac0-1e6b-446e-9493-95bcea2b3569 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:55.689993 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-35a74ac0-1e6b-446e-9493-95bcea2b3569 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:55.690602 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-35a74ac0-1e6b-446e-9493-95bcea2b3569 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:55.692116 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-35a74ac0-1e6b-446e-9493-95bcea2b3569 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:55.692934 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-35a74ac0-1e6b-446e-9493-95bcea2b3569 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:55.693364 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-35a74ac0-1e6b-446e-9493-95bcea2b3569 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:55.967973 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-35a74ac0-1e6b-446e-9493-95bcea2b3569 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:55.975712 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-35a74ac0-1e6b-446e-9493-95bcea2b3569 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.298344 Aug 29 19:02:55.976289 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 105/200] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:55 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:56.159845 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-b9a0ea73-092a-4be1-b178-a82ca8bee761 req-85f382e4-92be-49d9-9d67-7163253add62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4429ad44-4714-483b-b5b3-0091aabe6905", "tag": "cf8e3469-e506-47a4-b46f-3674e9c0abab"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:02:56.169206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-b9a0ea73-092a-4be1-b178-a82ca8bee761 req-85f382e4-92be-49d9-9d67-7163253add62 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:56.169677 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-b9a0ea73-092a-4be1-b178-a82ca8bee761 req-85f382e4-92be-49d9-9d67-7163253add62 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:56.170099 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-b9a0ea73-092a-4be1-b178-a82ca8bee761 req-85f382e4-92be-49d9-9d67-7163253add62 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:56.181317 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-b9a0ea73-092a-4be1-b178-a82ca8bee761 req-85f382e4-92be-49d9-9d67-7163253add62 service nova] Creating event network-changed:cf8e3469-e506-47a4-b46f-3674e9c0abab for instance 4429ad44-4714-483b-b5b3-0091aabe6905 on hv-cinder-85083 Aug 29 19:02:56.186454 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-b9a0ea73-092a-4be1-b178-a82ca8bee761 req-85f382e4-92be-49d9-9d67-7163253add62 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030108 Aug 29 19:02:56.187192 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 106/201] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:02:56.391738 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-fc4e8c6f-3e01-4718-b3c0-0bc4789094a8 req-2acfca5b-2c56-40ab-8ce8-254c85c7b74f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55705ba3-2981-43e1-80e0-29995ee472a9", "tag": "e7223967-a4dc-4ee2-8b85-82a153b42231"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:02:56.400869 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-fc4e8c6f-3e01-4718-b3c0-0bc4789094a8 req-2acfca5b-2c56-40ab-8ce8-254c85c7b74f service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:56.401343 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-fc4e8c6f-3e01-4718-b3c0-0bc4789094a8 req-2acfca5b-2c56-40ab-8ce8-254c85c7b74f service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:56.401762 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-fc4e8c6f-3e01-4718-b3c0-0bc4789094a8 req-2acfca5b-2c56-40ab-8ce8-254c85c7b74f service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:56.412632 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-fc4e8c6f-3e01-4718-b3c0-0bc4789094a8 req-2acfca5b-2c56-40ab-8ce8-254c85c7b74f service nova] Creating event network-changed:e7223967-a4dc-4ee2-8b85-82a153b42231 for instance 55705ba3-2981-43e1-80e0-29995ee472a9 on hv-cinder-85083 Aug 29 19:02:56.417507 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-fc4e8c6f-3e01-4718-b3c0-0bc4789094a8 req-2acfca5b-2c56-40ab-8ce8-254c85c7b74f service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030408 Aug 29 19:02:56.418092 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 107/202] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:02:56.676603 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-894f790d-032e-472c-be2b-7e0ef74028d0 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:56.678073 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-894f790d-032e-472c-be2b-7e0ef74028d0 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:56.687674 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-894f790d-032e-472c-be2b-7e0ef74028d0 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:56.688409 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-894f790d-032e-472c-be2b-7e0ef74028d0 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:56.689029 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-894f790d-032e-472c-be2b-7e0ef74028d0 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:56.690079 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-894f790d-032e-472c-be2b-7e0ef74028d0 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:56.690693 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-894f790d-032e-472c-be2b-7e0ef74028d0 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:56.691292 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-894f790d-032e-472c-be2b-7e0ef74028d0 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:56.767166 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-894f790d-032e-472c-be2b-7e0ef74028d0 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:56.775976 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-894f790d-032e-472c-be2b-7e0ef74028d0 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1217 microversion: 2.1 time: 0.103564 Aug 29 19:02:56.776558 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 108/203] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:56 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:56.996251 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-61f1389b-87b4-46c5-bca8-89f893d79f57 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:56.997023 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-61f1389b-87b4-46c5-bca8-89f893d79f57 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:57.004063 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-61f1389b-87b4-46c5-bca8-89f893d79f57 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:57.004622 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-61f1389b-87b4-46c5-bca8-89f893d79f57 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:57.005122 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-61f1389b-87b4-46c5-bca8-89f893d79f57 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:57.005994 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-61f1389b-87b4-46c5-bca8-89f893d79f57 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:57.006659 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-61f1389b-87b4-46c5-bca8-89f893d79f57 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:57.007432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-61f1389b-87b4-46c5-bca8-89f893d79f57 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:57.148961 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-61f1389b-87b4-46c5-bca8-89f893d79f57 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:57.160340 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-61f1389b-87b4-46c5-bca8-89f893d79f57 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.167841 Aug 29 19:02:57.160929 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 109/204] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:56 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:57.520477 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=11 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:57.797344 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ade0ad05-6ae4-455b-a5fb-920422a94727 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:57.798042 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ade0ad05-6ae4-455b-a5fb-920422a94727 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:57.803994 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ade0ad05-6ae4-455b-a5fb-920422a94727 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:57.804483 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ade0ad05-6ae4-455b-a5fb-920422a94727 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:57.804902 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ade0ad05-6ae4-455b-a5fb-920422a94727 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:57.805583 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ade0ad05-6ae4-455b-a5fb-920422a94727 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:57.806029 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ade0ad05-6ae4-455b-a5fb-920422a94727 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:57.806448 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ade0ad05-6ae4-455b-a5fb-920422a94727 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:57.869878 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ade0ad05-6ae4-455b-a5fb-920422a94727 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:57.878402 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ade0ad05-6ae4-455b-a5fb-920422a94727 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1217 microversion: 2.1 time: 0.085412 Aug 29 19:02:57.879015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 110/205] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:57 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:58.005812 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=82 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:58.181181 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f653f199-3904-4b27-ae6d-88e5093a2a43 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:58.181790 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f653f199-3904-4b27-ae6d-88e5093a2a43 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:58.187860 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f653f199-3904-4b27-ae6d-88e5093a2a43 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:58.188343 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f653f199-3904-4b27-ae6d-88e5093a2a43 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:58.188781 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f653f199-3904-4b27-ae6d-88e5093a2a43 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:58.189462 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f653f199-3904-4b27-ae6d-88e5093a2a43 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:58.189916 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f653f199-3904-4b27-ae6d-88e5093a2a43 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:58.190338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f653f199-3904-4b27-ae6d-88e5093a2a43 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:58.321492 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f653f199-3904-4b27-ae6d-88e5093a2a43 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:58.329002 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f653f199-3904-4b27-ae6d-88e5093a2a43 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.151749 Aug 29 19:02:58.329564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 111/206] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:58 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:02:58.600363 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-608e0cbd-f48b-43be-9890-751db81af419 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "POST /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.090596 Aug 29 19:02:58.600989 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 96/207] 10.222.0.86 () {60 vars in 1323 bytes} [Mon Aug 29 19:02:47 2022] POST /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6/os-volume_attachments => generated 194 bytes in 11092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:02:58.898601 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-17aac8a0-6b67-4afd-bdea-0f066bb0452f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:58.899160 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-17aac8a0-6b67-4afd-bdea-0f066bb0452f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:58.905823 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-17aac8a0-6b67-4afd-bdea-0f066bb0452f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:58.906304 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-17aac8a0-6b67-4afd-bdea-0f066bb0452f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:58.906738 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-17aac8a0-6b67-4afd-bdea-0f066bb0452f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:58.907492 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-17aac8a0-6b67-4afd-bdea-0f066bb0452f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:58.907950 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-17aac8a0-6b67-4afd-bdea-0f066bb0452f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:58.908371 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-17aac8a0-6b67-4afd-bdea-0f066bb0452f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:58.967698 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-17aac8a0-6b67-4afd-bdea-0f066bb0452f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:58.975211 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-17aac8a0-6b67-4afd-bdea-0f066bb0452f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1217 microversion: 2.1 time: 0.080482 Aug 29 19:02:58.975774 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 112/208] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:58 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:59.352192 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-53a13bec-adfa-4777-976f-81033844ee22 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:59.352878 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-53a13bec-adfa-4777-976f-81033844ee22 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:02:59.359021 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53a13bec-adfa-4777-976f-81033844ee22 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:59.359523 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53a13bec-adfa-4777-976f-81033844ee22 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:59.359951 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53a13bec-adfa-4777-976f-81033844ee22 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:59.360685 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53a13bec-adfa-4777-976f-81033844ee22 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:02:59.361133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53a13bec-adfa-4777-976f-81033844ee22 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:02:59.361600 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53a13bec-adfa-4777-976f-81033844ee22 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:02:59.496873 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-53a13bec-adfa-4777-976f-81033844ee22 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:02:59.505662 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-53a13bec-adfa-4777-976f-81033844ee22 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.157996 Aug 29 19:02:59.506237 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 97/209] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:59 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:59.996670 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8bf57143-071e-4daf-9c6d-ba3add626017 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:59.997196 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8bf57143-071e-4daf-9c6d-ba3add626017 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:00.003128 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8bf57143-071e-4daf-9c6d-ba3add626017 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:00.003605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8bf57143-071e-4daf-9c6d-ba3add626017 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:00.004029 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8bf57143-071e-4daf-9c6d-ba3add626017 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:00.004695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8bf57143-071e-4daf-9c6d-ba3add626017 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:00.005135 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8bf57143-071e-4daf-9c6d-ba3add626017 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:00.005545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8bf57143-071e-4daf-9c6d-ba3add626017 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:00.067152 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8bf57143-071e-4daf-9c6d-ba3add626017 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:00.074884 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8bf57143-071e-4daf-9c6d-ba3add626017 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1217 microversion: 2.1 time: 0.082286 Aug 29 19:03:00.075473 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 113/210] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:02:59 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:00.526793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3c1b09e1-64b5-4964-86aa-c1ebb93c44fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:00.527441 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3c1b09e1-64b5-4964-86aa-c1ebb93c44fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:00.533976 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c1b09e1-64b5-4964-86aa-c1ebb93c44fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:00.534450 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c1b09e1-64b5-4964-86aa-c1ebb93c44fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:00.534876 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c1b09e1-64b5-4964-86aa-c1ebb93c44fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:00.535574 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c1b09e1-64b5-4964-86aa-c1ebb93c44fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:00.536017 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c1b09e1-64b5-4964-86aa-c1ebb93c44fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:00.536430 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c1b09e1-64b5-4964-86aa-c1ebb93c44fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:00.663978 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3c1b09e1-64b5-4964-86aa-c1ebb93c44fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:00.672368 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3c1b09e1-64b5-4964-86aa-c1ebb93c44fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.149621 Aug 29 19:03:00.672938 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 98/211] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:00 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:01.096403 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3d0baa64-91b0-47d6-8bb2-06066631335b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:01.096934 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3d0baa64-91b0-47d6-8bb2-06066631335b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:01.102962 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d0baa64-91b0-47d6-8bb2-06066631335b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:01.103474 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d0baa64-91b0-47d6-8bb2-06066631335b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:01.103905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d0baa64-91b0-47d6-8bb2-06066631335b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:01.104591 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d0baa64-91b0-47d6-8bb2-06066631335b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:01.105039 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d0baa64-91b0-47d6-8bb2-06066631335b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:01.105458 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d0baa64-91b0-47d6-8bb2-06066631335b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:01.165699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3d0baa64-91b0-47d6-8bb2-06066631335b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:01.173855 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3d0baa64-91b0-47d6-8bb2-06066631335b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1217 microversion: 2.1 time: 0.082634 Aug 29 19:03:01.174415 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 114/212] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:01 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:01.693056 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a78073d5-2559-4722-bff8-9d9ad275297f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:01.693660 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a78073d5-2559-4722-bff8-9d9ad275297f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:01.700081 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a78073d5-2559-4722-bff8-9d9ad275297f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:01.700554 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a78073d5-2559-4722-bff8-9d9ad275297f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:01.701600 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a78073d5-2559-4722-bff8-9d9ad275297f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:01.702402 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a78073d5-2559-4722-bff8-9d9ad275297f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:01.702903 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a78073d5-2559-4722-bff8-9d9ad275297f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:01.703405 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a78073d5-2559-4722-bff8-9d9ad275297f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:01.838620 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a78073d5-2559-4722-bff8-9d9ad275297f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:01.846645 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a78073d5-2559-4722-bff8-9d9ad275297f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.157721 Aug 29 19:03:01.847235 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 99/213] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:01 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:02.194241 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ac5a279f-a881-46d6-8184-bc6dd4b28881 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:02.194850 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ac5a279f-a881-46d6-8184-bc6dd4b28881 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:02.201198 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac5a279f-a881-46d6-8184-bc6dd4b28881 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:02.201766 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac5a279f-a881-46d6-8184-bc6dd4b28881 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:02.202201 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac5a279f-a881-46d6-8184-bc6dd4b28881 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:02.202883 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac5a279f-a881-46d6-8184-bc6dd4b28881 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:02.203524 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac5a279f-a881-46d6-8184-bc6dd4b28881 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:02.203949 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac5a279f-a881-46d6-8184-bc6dd4b28881 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:02.263867 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ac5a279f-a881-46d6-8184-bc6dd4b28881 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:02.271322 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ac5a279f-a881-46d6-8184-bc6dd4b28881 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1217 microversion: 2.1 time: 0.081179 Aug 29 19:03:02.271889 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 115/214] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:02 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:02.867093 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fbd14625-b382-406f-8161-f828460302c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:02.867787 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fbd14625-b382-406f-8161-f828460302c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:02.874212 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fbd14625-b382-406f-8161-f828460302c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:02.874691 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fbd14625-b382-406f-8161-f828460302c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:02.875230 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fbd14625-b382-406f-8161-f828460302c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:02.875920 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fbd14625-b382-406f-8161-f828460302c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:02.876371 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fbd14625-b382-406f-8161-f828460302c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:02.876795 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fbd14625-b382-406f-8161-f828460302c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:03.008785 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fbd14625-b382-406f-8161-f828460302c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:03.016751 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fbd14625-b382-406f-8161-f828460302c6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.153445 Aug 29 19:03:03.017312 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 100/215] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:02 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:03.291486 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6c2e42a6-33db-492c-9a2a-34a4b67ccf49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:03.292112 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6c2e42a6-33db-492c-9a2a-34a4b67ccf49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:03.298155 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c2e42a6-33db-492c-9a2a-34a4b67ccf49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:03.298629 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c2e42a6-33db-492c-9a2a-34a4b67ccf49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:03.299084 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c2e42a6-33db-492c-9a2a-34a4b67ccf49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:03.299759 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c2e42a6-33db-492c-9a2a-34a4b67ccf49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:03.300202 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c2e42a6-33db-492c-9a2a-34a4b67ccf49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:03.300629 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c2e42a6-33db-492c-9a2a-34a4b67ccf49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:03.359598 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6c2e42a6-33db-492c-9a2a-34a4b67ccf49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:03.367089 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6c2e42a6-33db-492c-9a2a-34a4b67ccf49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1217 microversion: 2.1 time: 0.079397 Aug 29 19:03:03.367690 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 116/216] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:03 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:04.037533 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c176197f-7bd2-4641-962a-8ffdbc4816db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:04.038133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c176197f-7bd2-4641-962a-8ffdbc4816db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:04.044440 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c176197f-7bd2-4641-962a-8ffdbc4816db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:04.044920 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c176197f-7bd2-4641-962a-8ffdbc4816db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:04.045437 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c176197f-7bd2-4641-962a-8ffdbc4816db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:04.046114 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c176197f-7bd2-4641-962a-8ffdbc4816db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:04.046563 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c176197f-7bd2-4641-962a-8ffdbc4816db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:04.046976 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c176197f-7bd2-4641-962a-8ffdbc4816db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:04.176852 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c176197f-7bd2-4641-962a-8ffdbc4816db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:04.184459 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c176197f-7bd2-4641-962a-8ffdbc4816db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.150790 Aug 29 19:03:04.185027 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 101/217] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:04 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:04.388500 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0caf30c3-faab-4ce6-8c49-0e012efba19c tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:04.389063 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0caf30c3-faab-4ce6-8c49-0e012efba19c tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:04.391269 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:04.396509 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0caf30c3-faab-4ce6-8c49-0e012efba19c tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:04.396985 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0caf30c3-faab-4ce6-8c49-0e012efba19c tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:04.397411 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0caf30c3-faab-4ce6-8c49-0e012efba19c tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:04.398092 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0caf30c3-faab-4ce6-8c49-0e012efba19c tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:04.398535 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0caf30c3-faab-4ce6-8c49-0e012efba19c tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:04.398948 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0caf30c3-faab-4ce6-8c49-0e012efba19c tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:04.484309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0caf30c3-faab-4ce6-8c49-0e012efba19c tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:04.492562 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0caf30c3-faab-4ce6-8c49-0e012efba19c tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1209 microversion: 2.1 time: 0.108441 Aug 29 19:03:04.493139 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 117/218] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:04 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1209 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:05.206256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5783a6c4-1a6d-4d86-a425-02fbfbce85f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:05.206804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5783a6c4-1a6d-4d86-a425-02fbfbce85f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:05.213262 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5783a6c4-1a6d-4d86-a425-02fbfbce85f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:05.213745 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5783a6c4-1a6d-4d86-a425-02fbfbce85f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:05.214183 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5783a6c4-1a6d-4d86-a425-02fbfbce85f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:05.214867 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5783a6c4-1a6d-4d86-a425-02fbfbce85f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:05.215347 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5783a6c4-1a6d-4d86-a425-02fbfbce85f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:05.215772 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5783a6c4-1a6d-4d86-a425-02fbfbce85f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:05.343043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5783a6c4-1a6d-4d86-a425-02fbfbce85f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:05.350551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5783a6c4-1a6d-4d86-a425-02fbfbce85f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.148182 Aug 29 19:03:05.351129 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 102/219] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:05 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:05.513615 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b43af253-28ef-4a71-8ed2-514ac1e273dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:05.515152 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b43af253-28ef-4a71-8ed2-514ac1e273dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:05.516965 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=8 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:05.522345 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b43af253-28ef-4a71-8ed2-514ac1e273dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:05.522823 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b43af253-28ef-4a71-8ed2-514ac1e273dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:05.523283 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b43af253-28ef-4a71-8ed2-514ac1e273dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:05.523963 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b43af253-28ef-4a71-8ed2-514ac1e273dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:05.524495 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b43af253-28ef-4a71-8ed2-514ac1e273dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:05.524923 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b43af253-28ef-4a71-8ed2-514ac1e273dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:05.591157 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b43af253-28ef-4a71-8ed2-514ac1e273dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:05.599569 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b43af253-28ef-4a71-8ed2-514ac1e273dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1209 microversion: 2.1 time: 0.089679 Aug 29 19:03:05.600185 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 118/220] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:05 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:06.371778 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-186d0fd2-524b-47bf-b935-1c0c4294ce4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:06.372364 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-186d0fd2-524b-47bf-b935-1c0c4294ce4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:06.379709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-186d0fd2-524b-47bf-b935-1c0c4294ce4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:06.380200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-186d0fd2-524b-47bf-b935-1c0c4294ce4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:06.380833 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-186d0fd2-524b-47bf-b935-1c0c4294ce4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:06.381554 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-186d0fd2-524b-47bf-b935-1c0c4294ce4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:06.382008 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-186d0fd2-524b-47bf-b935-1c0c4294ce4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:06.382425 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-186d0fd2-524b-47bf-b935-1c0c4294ce4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:06.517759 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-186d0fd2-524b-47bf-b935-1c0c4294ce4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:06.525387 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-186d0fd2-524b-47bf-b935-1c0c4294ce4a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1321 microversion: 2.1 time: 0.157709 Aug 29 19:03:06.525944 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 103/221] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:06 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:06.621336 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3a4b319e-6f11-482c-b29b-5aa427e0847a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:06.622730 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3a4b319e-6f11-482c-b29b-5aa427e0847a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:06.628954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a4b319e-6f11-482c-b29b-5aa427e0847a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:06.629434 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a4b319e-6f11-482c-b29b-5aa427e0847a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:06.629865 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a4b319e-6f11-482c-b29b-5aa427e0847a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:06.630547 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a4b319e-6f11-482c-b29b-5aa427e0847a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:06.630990 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a4b319e-6f11-482c-b29b-5aa427e0847a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:06.631479 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a4b319e-6f11-482c-b29b-5aa427e0847a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:06.701988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3a4b319e-6f11-482c-b29b-5aa427e0847a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:06.710011 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3a4b319e-6f11-482c-b29b-5aa427e0847a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1265 microversion: 2.1 time: 0.092636 Aug 29 19:03:06.710572 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 119/222] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:06 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:07.546163 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d92a2f06-9da4-4ead-baf7-e707a4d4a622 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:07.546969 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d92a2f06-9da4-4ead-baf7-e707a4d4a622 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:07.553450 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d92a2f06-9da4-4ead-baf7-e707a4d4a622 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:07.553951 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d92a2f06-9da4-4ead-baf7-e707a4d4a622 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:07.554364 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d92a2f06-9da4-4ead-baf7-e707a4d4a622 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:07.555083 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d92a2f06-9da4-4ead-baf7-e707a4d4a622 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:07.555531 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d92a2f06-9da4-4ead-baf7-e707a4d4a622 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:07.555958 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d92a2f06-9da4-4ead-baf7-e707a4d4a622 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:07.732434 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6a774c0b-35f1-45f4-8f97-331d37e2dd36 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:07.733925 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6a774c0b-35f1-45f4-8f97-331d37e2dd36 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:07.749347 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a774c0b-35f1-45f4-8f97-331d37e2dd36 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:07.749871 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a774c0b-35f1-45f4-8f97-331d37e2dd36 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:07.750378 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a774c0b-35f1-45f4-8f97-331d37e2dd36 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:07.751115 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a774c0b-35f1-45f4-8f97-331d37e2dd36 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:07.751567 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a774c0b-35f1-45f4-8f97-331d37e2dd36 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:07.751986 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a774c0b-35f1-45f4-8f97-331d37e2dd36 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:07.797248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:07.891061 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6a774c0b-35f1-45f4-8f97-331d37e2dd36 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:07.902321 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6a774c0b-35f1-45f4-8f97-331d37e2dd36 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1273 microversion: 2.1 time: 0.174307 Aug 29 19:03:07.915874 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 120/223] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:07 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:07.938618 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d92a2f06-9da4-4ead-baf7-e707a4d4a622 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:07.947991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d92a2f06-9da4-4ead-baf7-e707a4d4a622 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1515 microversion: 2.1 time: 0.405972 Aug 29 19:03:07.948428 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 104/224] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:07 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1515 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:07.969771 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fe817c07-bc77-4c4d-ab03-9d335b1f8b08 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:03:07.971972 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fe817c07-bc77-4c4d-ab03-9d335b1f8b08 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:07.978173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fe817c07-bc77-4c4d-ab03-9d335b1f8b08 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:07.978664 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fe817c07-bc77-4c4d-ab03-9d335b1f8b08 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:07.979127 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fe817c07-bc77-4c4d-ab03-9d335b1f8b08 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:07.979816 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fe817c07-bc77-4c4d-ab03-9d335b1f8b08 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:07.980262 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fe817c07-bc77-4c4d-ab03-9d335b1f8b08 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:07.980676 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fe817c07-bc77-4c4d-ab03-9d335b1f8b08 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:08.004664 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-fe817c07-bc77-4c4d-ab03-9d335b1f8b08 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lazy-loading 'flavor' on Instance uuid c01f30bf-2698-4cae-a884-141ce3b7862a {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:03:08.134693 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fe817c07-bc77-4c4d-ab03-9d335b1f8b08 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "POST /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a/action" status: 200 len: 32 microversion: 2.1 time: 0.169412 Aug 29 19:03:08.140350 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 121/225] 10.222.0.86 () {60 vars in 1278 bytes} [Mon Aug 29 19:03:07 2022] POST /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:03:08.146014 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-05040c85-463f-4f40-99af-7972d1d168bb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:08.146617 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-05040c85-463f-4f40-99af-7972d1d168bb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:08.152591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-05040c85-463f-4f40-99af-7972d1d168bb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:08.153075 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-05040c85-463f-4f40-99af-7972d1d168bb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:08.153503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-05040c85-463f-4f40-99af-7972d1d168bb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:08.154181 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-05040c85-463f-4f40-99af-7972d1d168bb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:08.155358 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-05040c85-463f-4f40-99af-7972d1d168bb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:08.165608 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-05040c85-463f-4f40-99af-7972d1d168bb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:08.330588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-05040c85-463f-4f40-99af-7972d1d168bb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:08.338383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-05040c85-463f-4f40-99af-7972d1d168bb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.196206 Aug 29 19:03:08.352738 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 105/226] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:08 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:08.925394 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-be5a1e3d-a660-4949-8ffc-80aac4ceae00 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:08.926845 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-be5a1e3d-a660-4949-8ffc-80aac4ceae00 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:08.929065 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:08.938829 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-be5a1e3d-a660-4949-8ffc-80aac4ceae00 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:08.938829 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-be5a1e3d-a660-4949-8ffc-80aac4ceae00 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:08.939449 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-be5a1e3d-a660-4949-8ffc-80aac4ceae00 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:08.940987 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-be5a1e3d-a660-4949-8ffc-80aac4ceae00 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:08.941879 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-be5a1e3d-a660-4949-8ffc-80aac4ceae00 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:08.942532 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-be5a1e3d-a660-4949-8ffc-80aac4ceae00 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:09.177764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-be5a1e3d-a660-4949-8ffc-80aac4ceae00 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:09.190451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-be5a1e3d-a660-4949-8ffc-80aac4ceae00 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1313 microversion: 2.1 time: 0.269267 Aug 29 19:03:09.197004 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 122/227] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:08 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:09.362545 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d43b7853-7787-487d-9d95-f3671f0f4d5c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:09.364099 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d43b7853-7787-487d-9d95-f3671f0f4d5c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:09.371413 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d43b7853-7787-487d-9d95-f3671f0f4d5c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:09.372200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d43b7853-7787-487d-9d95-f3671f0f4d5c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:09.372528 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d43b7853-7787-487d-9d95-f3671f0f4d5c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:09.373358 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d43b7853-7787-487d-9d95-f3671f0f4d5c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:09.373874 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d43b7853-7787-487d-9d95-f3671f0f4d5c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:09.374366 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d43b7853-7787-487d-9d95-f3671f0f4d5c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:09.382508 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-7fd43674-b0c2-45a1-8a3e-5b2026f620f2 req-c9e9941e-fd73-4138-a3ed-c57e0c14eaa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eb66341-ca69-4bc3-84bc-4f44a8e429e1", "tag": "18b2a31c-dd80-4597-beef-98ade3515d75"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:03:09.395478 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-7fd43674-b0c2-45a1-8a3e-5b2026f620f2 req-c9e9941e-fd73-4138-a3ed-c57e0c14eaa5 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:09.402824 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-7fd43674-b0c2-45a1-8a3e-5b2026f620f2 req-c9e9941e-fd73-4138-a3ed-c57e0c14eaa5 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:09.403426 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-7fd43674-b0c2-45a1-8a3e-5b2026f620f2 req-c9e9941e-fd73-4138-a3ed-c57e0c14eaa5 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:09.426663 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-7fd43674-b0c2-45a1-8a3e-5b2026f620f2 req-c9e9941e-fd73-4138-a3ed-c57e0c14eaa5 service nova] Creating event network-changed:18b2a31c-dd80-4597-beef-98ade3515d75 for instance 8eb66341-ca69-4bc3-84bc-4f44a8e429e1 on hv-cinder-85083 Aug 29 19:03:09.441172 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-7fd43674-b0c2-45a1-8a3e-5b2026f620f2 req-c9e9941e-fd73-4138-a3ed-c57e0c14eaa5 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062143 Aug 29 19:03:09.441834 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 123/228] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:03:09.564866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d43b7853-7787-487d-9d95-f3671f0f4d5c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:09.574493 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d43b7853-7787-487d-9d95-f3671f0f4d5c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.215673 Aug 29 19:03:09.575736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 106/229] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:09 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:10.213546 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bf199a37-6943-4fc6-ab9f-344f44ab2758 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:10.214247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bf199a37-6943-4fc6-ab9f-344f44ab2758 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:10.220604 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bf199a37-6943-4fc6-ab9f-344f44ab2758 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:10.221082 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bf199a37-6943-4fc6-ab9f-344f44ab2758 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:10.221724 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bf199a37-6943-4fc6-ab9f-344f44ab2758 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:10.222417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bf199a37-6943-4fc6-ab9f-344f44ab2758 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:10.223045 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bf199a37-6943-4fc6-ab9f-344f44ab2758 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:10.223488 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bf199a37-6943-4fc6-ab9f-344f44ab2758 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:10.370611 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bf199a37-6943-4fc6-ab9f-344f44ab2758 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:10.379983 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bf199a37-6943-4fc6-ab9f-344f44ab2758 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1313 microversion: 2.1 time: 0.170599 Aug 29 19:03:10.380653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 124/230] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:10 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:10.597185 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a6393db7-746f-4626-9807-3f007a8bec86 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:10.597799 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a6393db7-746f-4626-9807-3f007a8bec86 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:10.606047 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6393db7-746f-4626-9807-3f007a8bec86 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:10.607210 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6393db7-746f-4626-9807-3f007a8bec86 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:10.608573 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6393db7-746f-4626-9807-3f007a8bec86 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:10.610497 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6393db7-746f-4626-9807-3f007a8bec86 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:10.610959 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6393db7-746f-4626-9807-3f007a8bec86 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:10.611469 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6393db7-746f-4626-9807-3f007a8bec86 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:10.782172 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a6393db7-746f-4626-9807-3f007a8bec86 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:10.790570 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a6393db7-746f-4626-9807-3f007a8bec86 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.199549 Aug 29 19:03:10.791138 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 107/231] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:10 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:11.404676 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c39da8c2-aa2e-4f37-ad2f-e6c2f8fdc496 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:11.405277 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c39da8c2-aa2e-4f37-ad2f-e6c2f8fdc496 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:11.411572 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c39da8c2-aa2e-4f37-ad2f-e6c2f8fdc496 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:11.412049 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c39da8c2-aa2e-4f37-ad2f-e6c2f8fdc496 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:11.412474 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c39da8c2-aa2e-4f37-ad2f-e6c2f8fdc496 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:11.413155 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c39da8c2-aa2e-4f37-ad2f-e6c2f8fdc496 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:11.413601 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c39da8c2-aa2e-4f37-ad2f-e6c2f8fdc496 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:11.414014 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c39da8c2-aa2e-4f37-ad2f-e6c2f8fdc496 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:11.555885 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c39da8c2-aa2e-4f37-ad2f-e6c2f8fdc496 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:11.564107 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c39da8c2-aa2e-4f37-ad2f-e6c2f8fdc496 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1313 microversion: 2.1 time: 0.163340 Aug 29 19:03:11.564698 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 125/232] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:11 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:11.813426 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bec09175-e153-422d-9e7f-d8b8aa5aeb69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:11.814606 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bec09175-e153-422d-9e7f-d8b8aa5aeb69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:11.821201 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bec09175-e153-422d-9e7f-d8b8aa5aeb69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:11.821729 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bec09175-e153-422d-9e7f-d8b8aa5aeb69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:11.822107 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bec09175-e153-422d-9e7f-d8b8aa5aeb69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:11.822794 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bec09175-e153-422d-9e7f-d8b8aa5aeb69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:11.823277 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bec09175-e153-422d-9e7f-d8b8aa5aeb69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:11.823702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bec09175-e153-422d-9e7f-d8b8aa5aeb69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:11.957577 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bec09175-e153-422d-9e7f-d8b8aa5aeb69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:11.965153 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bec09175-e153-422d-9e7f-d8b8aa5aeb69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.156300 Aug 29 19:03:11.965716 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 108/233] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:11 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:12.585323 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-770a037c-17c4-41fb-a1f8-254c0f6f2652 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:12.585990 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-770a037c-17c4-41fb-a1f8-254c0f6f2652 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:12.592100 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-770a037c-17c4-41fb-a1f8-254c0f6f2652 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:12.592584 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-770a037c-17c4-41fb-a1f8-254c0f6f2652 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:12.593018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-770a037c-17c4-41fb-a1f8-254c0f6f2652 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:12.593766 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-770a037c-17c4-41fb-a1f8-254c0f6f2652 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:12.594219 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-770a037c-17c4-41fb-a1f8-254c0f6f2652 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:12.594630 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-770a037c-17c4-41fb-a1f8-254c0f6f2652 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:12.741985 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-770a037c-17c4-41fb-a1f8-254c0f6f2652 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:12.750802 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-770a037c-17c4-41fb-a1f8-254c0f6f2652 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1313 microversion: 2.1 time: 0.169359 Aug 29 19:03:12.755403 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 126/234] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:12 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:12.987019 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-eaa9e626-9999-4481-b4e6-b96164117e41 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:12.988625 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-eaa9e626-9999-4481-b4e6-b96164117e41 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:12.995262 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eaa9e626-9999-4481-b4e6-b96164117e41 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:12.995743 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eaa9e626-9999-4481-b4e6-b96164117e41 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:12.996185 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eaa9e626-9999-4481-b4e6-b96164117e41 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:12.996883 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eaa9e626-9999-4481-b4e6-b96164117e41 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:12.997326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eaa9e626-9999-4481-b4e6-b96164117e41 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:12.997748 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eaa9e626-9999-4481-b4e6-b96164117e41 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:13.151402 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-eaa9e626-9999-4481-b4e6-b96164117e41 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:13.160940 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-eaa9e626-9999-4481-b4e6-b96164117e41 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.179206 Aug 29 19:03:13.161518 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 109/235] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:12 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:13.775227 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b025bf8b-9865-46bf-8c79-23d51e570c49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:13.775794 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b025bf8b-9865-46bf-8c79-23d51e570c49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:13.784816 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b025bf8b-9865-46bf-8c79-23d51e570c49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:13.785666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b025bf8b-9865-46bf-8c79-23d51e570c49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:13.786611 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b025bf8b-9865-46bf-8c79-23d51e570c49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:13.787481 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b025bf8b-9865-46bf-8c79-23d51e570c49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:13.789706 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b025bf8b-9865-46bf-8c79-23d51e570c49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:13.790340 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b025bf8b-9865-46bf-8c79-23d51e570c49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:13.956101 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b025bf8b-9865-46bf-8c79-23d51e570c49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:13.964707 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b025bf8b-9865-46bf-8c79-23d51e570c49 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1313 microversion: 2.1 time: 0.194942 Aug 29 19:03:13.965281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 127/236] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:13 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:14.182327 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d6b4c44c-30fb-42c6-b6a7-f493e67ad1d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:14.182944 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d6b4c44c-30fb-42c6-b6a7-f493e67ad1d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:14.189550 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6b4c44c-30fb-42c6-b6a7-f493e67ad1d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:14.190025 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6b4c44c-30fb-42c6-b6a7-f493e67ad1d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:14.190452 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6b4c44c-30fb-42c6-b6a7-f493e67ad1d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:14.191151 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6b4c44c-30fb-42c6-b6a7-f493e67ad1d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:14.191615 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6b4c44c-30fb-42c6-b6a7-f493e67ad1d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:14.192012 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6b4c44c-30fb-42c6-b6a7-f493e67ad1d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:14.320218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d6b4c44c-30fb-42c6-b6a7-f493e67ad1d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:14.328379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d6b4c44c-30fb-42c6-b6a7-f493e67ad1d2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.149917 Aug 29 19:03:14.328938 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 110/237] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:14 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:14.986669 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d17f40fd-3fd8-4987-8f78-c7c2fba1604e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:14.987316 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d17f40fd-3fd8-4987-8f78-c7c2fba1604e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:14.993269 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d17f40fd-3fd8-4987-8f78-c7c2fba1604e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:14.993755 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d17f40fd-3fd8-4987-8f78-c7c2fba1604e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:14.994188 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d17f40fd-3fd8-4987-8f78-c7c2fba1604e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:14.994872 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d17f40fd-3fd8-4987-8f78-c7c2fba1604e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:14.995354 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d17f40fd-3fd8-4987-8f78-c7c2fba1604e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:14.995773 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d17f40fd-3fd8-4987-8f78-c7c2fba1604e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:15.125757 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d17f40fd-3fd8-4987-8f78-c7c2fba1604e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:15.134477 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d17f40fd-3fd8-4987-8f78-c7c2fba1604e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1313 microversion: 2.1 time: 0.152025 Aug 29 19:03:15.135104 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 128/238] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:14 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:15.349280 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1e0595d9-7616-4293-85c6-9e6791f71ff4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:15.349903 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1e0595d9-7616-4293-85c6-9e6791f71ff4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:15.356897 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e0595d9-7616-4293-85c6-9e6791f71ff4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:15.357316 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e0595d9-7616-4293-85c6-9e6791f71ff4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:15.357799 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e0595d9-7616-4293-85c6-9e6791f71ff4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:15.358482 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e0595d9-7616-4293-85c6-9e6791f71ff4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:15.358925 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e0595d9-7616-4293-85c6-9e6791f71ff4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:15.359363 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e0595d9-7616-4293-85c6-9e6791f71ff4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:15.488013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1e0595d9-7616-4293-85c6-9e6791f71ff4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:15.495628 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1e0595d9-7616-4293-85c6-9e6791f71ff4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.150252 Aug 29 19:03:15.496187 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 111/239] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:15 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:16.154754 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cfa9e129-36da-4e8d-8054-5d325bfd90be tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:16.155643 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cfa9e129-36da-4e8d-8054-5d325bfd90be tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:16.161527 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfa9e129-36da-4e8d-8054-5d325bfd90be tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:16.162004 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfa9e129-36da-4e8d-8054-5d325bfd90be tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:16.162427 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfa9e129-36da-4e8d-8054-5d325bfd90be tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:16.163149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfa9e129-36da-4e8d-8054-5d325bfd90be tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:16.163575 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfa9e129-36da-4e8d-8054-5d325bfd90be tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:16.163987 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfa9e129-36da-4e8d-8054-5d325bfd90be tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:16.289610 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cfa9e129-36da-4e8d-8054-5d325bfd90be tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:16.297759 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cfa9e129-36da-4e8d-8054-5d325bfd90be tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1313 microversion: 2.1 time: 0.146991 Aug 29 19:03:16.298310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 129/240] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:16 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:16.516093 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2ee845cb-4260-45a0-9ae9-a9ef521a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:16.516998 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2ee845cb-4260-45a0-9ae9-a9ef521a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:16.523081 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ee845cb-4260-45a0-9ae9-a9ef521a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:16.523626 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ee845cb-4260-45a0-9ae9-a9ef521a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:16.524115 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ee845cb-4260-45a0-9ae9-a9ef521a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:16.524915 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ee845cb-4260-45a0-9ae9-a9ef521a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:16.525402 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ee845cb-4260-45a0-9ae9-a9ef521a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:16.525852 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ee845cb-4260-45a0-9ae9-a9ef521a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:16.529904 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:16.660133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2ee845cb-4260-45a0-9ae9-a9ef521a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:16.671232 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2ee845cb-4260-45a0-9ae9-a9ef521a9ec0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.159059 Aug 29 19:03:16.672237 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 112/241] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:16 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:17.318895 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b643d564-b130-4501-8999-19ecc209b33f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:17.319522 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b643d564-b130-4501-8999-19ecc209b33f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:17.325380 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b643d564-b130-4501-8999-19ecc209b33f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:17.325859 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b643d564-b130-4501-8999-19ecc209b33f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:17.326783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b643d564-b130-4501-8999-19ecc209b33f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:17.327482 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b643d564-b130-4501-8999-19ecc209b33f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:17.327925 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b643d564-b130-4501-8999-19ecc209b33f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:17.328338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b643d564-b130-4501-8999-19ecc209b33f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:17.453051 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b643d564-b130-4501-8999-19ecc209b33f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:17.460515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b643d564-b130-4501-8999-19ecc209b33f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1313 microversion: 2.1 time: 0.145809 Aug 29 19:03:17.461070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 130/242] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:17 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:17.692280 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5568aed2-0413-40f1-a594-213c257bb73b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:17.693129 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5568aed2-0413-40f1-a594-213c257bb73b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:17.699465 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5568aed2-0413-40f1-a594-213c257bb73b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:17.699940 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5568aed2-0413-40f1-a594-213c257bb73b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:17.700362 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5568aed2-0413-40f1-a594-213c257bb73b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:17.701692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5568aed2-0413-40f1-a594-213c257bb73b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:17.702198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5568aed2-0413-40f1-a594-213c257bb73b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:17.702614 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5568aed2-0413-40f1-a594-213c257bb73b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:17.832198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5568aed2-0413-40f1-a594-213c257bb73b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:17.839847 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5568aed2-0413-40f1-a594-213c257bb73b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.151320 Aug 29 19:03:17.840412 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 113/243] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:17 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:18.481358 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-34d401b1-7f58-447d-a73d-5d75a965fbc9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:18.481967 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-34d401b1-7f58-447d-a73d-5d75a965fbc9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:18.487993 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-34d401b1-7f58-447d-a73d-5d75a965fbc9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:18.488473 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-34d401b1-7f58-447d-a73d-5d75a965fbc9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:18.488904 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-34d401b1-7f58-447d-a73d-5d75a965fbc9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:18.489583 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-34d401b1-7f58-447d-a73d-5d75a965fbc9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:18.490031 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-34d401b1-7f58-447d-a73d-5d75a965fbc9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:18.490448 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-34d401b1-7f58-447d-a73d-5d75a965fbc9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:18.616627 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-34d401b1-7f58-447d-a73d-5d75a965fbc9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:18.624757 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-34d401b1-7f58-447d-a73d-5d75a965fbc9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1313 microversion: 2.1 time: 0.147236 Aug 29 19:03:18.625310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 131/244] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:18 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:18.860117 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-63c9ecd2-7706-4309-905c-fa94c12ef0bf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:18.860632 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-63c9ecd2-7706-4309-905c-fa94c12ef0bf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:18.866614 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63c9ecd2-7706-4309-905c-fa94c12ef0bf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:18.867122 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63c9ecd2-7706-4309-905c-fa94c12ef0bf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:18.867550 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63c9ecd2-7706-4309-905c-fa94c12ef0bf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:18.868249 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63c9ecd2-7706-4309-905c-fa94c12ef0bf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:18.868692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63c9ecd2-7706-4309-905c-fa94c12ef0bf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:18.869106 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63c9ecd2-7706-4309-905c-fa94c12ef0bf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:19.000367 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-63c9ecd2-7706-4309-905c-fa94c12ef0bf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:19.007991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-63c9ecd2-7706-4309-905c-fa94c12ef0bf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.152410 Aug 29 19:03:19.008556 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 114/245] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:18 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:19.645552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-85051550-08e7-45b5-8a7f-e0efb3044493 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:19.646064 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-85051550-08e7-45b5-8a7f-e0efb3044493 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:19.651924 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85051550-08e7-45b5-8a7f-e0efb3044493 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:19.652401 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85051550-08e7-45b5-8a7f-e0efb3044493 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:19.652828 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85051550-08e7-45b5-8a7f-e0efb3044493 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:19.653514 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85051550-08e7-45b5-8a7f-e0efb3044493 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:19.653949 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85051550-08e7-45b5-8a7f-e0efb3044493 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:19.655021 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85051550-08e7-45b5-8a7f-e0efb3044493 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:19.785952 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-85051550-08e7-45b5-8a7f-e0efb3044493 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:19.797355 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-85051550-08e7-45b5-8a7f-e0efb3044493 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1313 microversion: 2.1 time: 0.155402 Aug 29 19:03:19.798032 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 132/246] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:19 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:20.028217 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c08cf789-c99a-4b23-944f-917bd4cde017 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:20.028836 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c08cf789-c99a-4b23-944f-917bd4cde017 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:20.035758 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c08cf789-c99a-4b23-944f-917bd4cde017 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:20.036242 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c08cf789-c99a-4b23-944f-917bd4cde017 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:20.036668 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c08cf789-c99a-4b23-944f-917bd4cde017 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:20.037357 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c08cf789-c99a-4b23-944f-917bd4cde017 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:20.037799 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c08cf789-c99a-4b23-944f-917bd4cde017 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:20.038215 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c08cf789-c99a-4b23-944f-917bd4cde017 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:20.167212 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c08cf789-c99a-4b23-944f-917bd4cde017 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:20.176209 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c08cf789-c99a-4b23-944f-917bd4cde017 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.152032 Aug 29 19:03:20.176858 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 115/247] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:20 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:20.818640 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-97ec5bd2-9b9c-4110-af21-7fb15269a1ba tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:20.819291 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-97ec5bd2-9b9c-4110-af21-7fb15269a1ba tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:20.825190 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-97ec5bd2-9b9c-4110-af21-7fb15269a1ba tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:20.825671 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-97ec5bd2-9b9c-4110-af21-7fb15269a1ba tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:20.826099 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-97ec5bd2-9b9c-4110-af21-7fb15269a1ba tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:20.826778 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-97ec5bd2-9b9c-4110-af21-7fb15269a1ba tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:20.827254 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-97ec5bd2-9b9c-4110-af21-7fb15269a1ba tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:20.827674 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-97ec5bd2-9b9c-4110-af21-7fb15269a1ba tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:20.962060 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-97ec5bd2-9b9c-4110-af21-7fb15269a1ba tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:20.970821 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-97ec5bd2-9b9c-4110-af21-7fb15269a1ba tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1313 microversion: 2.1 time: 0.156205 Aug 29 19:03:20.971428 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 133/248] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:20 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:21.036108 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-a35c99cf-315a-4b1a-978e-4a77f6bfc313 req-c0bdffe2-6bb9-4096-9d26-73c34946f64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb66341-ca69-4bc3-84bc-4f44a8e429e1", "name": "network-vif-plugged", "status": "completed", "tag": "18b2a31c-dd80-4597-beef-98ade3515d75"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:03:21.047409 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-a35c99cf-315a-4b1a-978e-4a77f6bfc313 req-c0bdffe2-6bb9-4096-9d26-73c34946f64b service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:21.047892 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-a35c99cf-315a-4b1a-978e-4a77f6bfc313 req-c0bdffe2-6bb9-4096-9d26-73c34946f64b service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:21.048545 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-a35c99cf-315a-4b1a-978e-4a77f6bfc313 req-c0bdffe2-6bb9-4096-9d26-73c34946f64b service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:21.060821 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-a35c99cf-315a-4b1a-978e-4a77f6bfc313 req-c0bdffe2-6bb9-4096-9d26-73c34946f64b service nova] Creating event network-vif-plugged:18b2a31c-dd80-4597-beef-98ade3515d75 for instance 8eb66341-ca69-4bc3-84bc-4f44a8e429e1 on hv-cinder-85083 Aug 29 19:03:21.067158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-a35c99cf-315a-4b1a-978e-4a77f6bfc313 req-c0bdffe2-6bb9-4096-9d26-73c34946f64b service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034822 Aug 29 19:03:21.068219 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 116/249] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:03:21.197857 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-38612a36-1462-4a39-ade5-e5e2ea7a84e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:21.198471 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-38612a36-1462-4a39-ade5-e5e2ea7a84e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:21.205107 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38612a36-1462-4a39-ade5-e5e2ea7a84e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:21.205665 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38612a36-1462-4a39-ade5-e5e2ea7a84e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:21.206221 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38612a36-1462-4a39-ade5-e5e2ea7a84e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:21.206775 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38612a36-1462-4a39-ade5-e5e2ea7a84e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:21.207257 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38612a36-1462-4a39-ade5-e5e2ea7a84e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:21.207684 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38612a36-1462-4a39-ade5-e5e2ea7a84e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:21.341156 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-38612a36-1462-4a39-ade5-e5e2ea7a84e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:21.348864 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-38612a36-1462-4a39-ade5-e5e2ea7a84e4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.154850 Aug 29 19:03:21.349449 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 134/250] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:21 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:21.993204 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b0544b2b-da0b-4263-9157-dabf0d5f21e6 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:21.994143 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b0544b2b-da0b-4263-9157-dabf0d5f21e6 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:22.001885 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b0544b2b-da0b-4263-9157-dabf0d5f21e6 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:22.002379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b0544b2b-da0b-4263-9157-dabf0d5f21e6 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:22.003449 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b0544b2b-da0b-4263-9157-dabf0d5f21e6 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:22.004503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b0544b2b-da0b-4263-9157-dabf0d5f21e6 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:22.005042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b0544b2b-da0b-4263-9157-dabf0d5f21e6 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:22.005833 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b0544b2b-da0b-4263-9157-dabf0d5f21e6 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:22.150646 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b0544b2b-da0b-4263-9157-dabf0d5f21e6 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:22.160700 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b0544b2b-da0b-4263-9157-dabf0d5f21e6 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1313 microversion: 2.1 time: 0.172951 Aug 29 19:03:22.161383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 117/251] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:21 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:22.369427 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bfe7abd7-9aaf-4fb6-9df8-67bf1ee71a9b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:22.370037 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bfe7abd7-9aaf-4fb6-9df8-67bf1ee71a9b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:22.375935 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfe7abd7-9aaf-4fb6-9df8-67bf1ee71a9b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:22.376414 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfe7abd7-9aaf-4fb6-9df8-67bf1ee71a9b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:22.376846 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfe7abd7-9aaf-4fb6-9df8-67bf1ee71a9b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:22.377525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfe7abd7-9aaf-4fb6-9df8-67bf1ee71a9b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:22.377974 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfe7abd7-9aaf-4fb6-9df8-67bf1ee71a9b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:22.378396 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfe7abd7-9aaf-4fb6-9df8-67bf1ee71a9b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:22.393686 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:22.526209 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bfe7abd7-9aaf-4fb6-9df8-67bf1ee71a9b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:22.548136 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bfe7abd7-9aaf-4fb6-9df8-67bf1ee71a9b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.182104 Aug 29 19:03:22.552131 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 135/252] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:22 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:23.184039 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a914f8b2-9ddf-45e1-836c-e82b2dcb32a9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:23.184751 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a914f8b2-9ddf-45e1-836c-e82b2dcb32a9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:23.191750 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a914f8b2-9ddf-45e1-836c-e82b2dcb32a9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:23.192309 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a914f8b2-9ddf-45e1-836c-e82b2dcb32a9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:23.193164 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a914f8b2-9ddf-45e1-836c-e82b2dcb32a9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:23.194004 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a914f8b2-9ddf-45e1-836c-e82b2dcb32a9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:23.194453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a914f8b2-9ddf-45e1-836c-e82b2dcb32a9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:23.194873 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a914f8b2-9ddf-45e1-836c-e82b2dcb32a9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:23.449980 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a914f8b2-9ddf-45e1-836c-e82b2dcb32a9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:23.461985 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a914f8b2-9ddf-45e1-836c-e82b2dcb32a9 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1313 microversion: 2.1 time: 0.281780 Aug 29 19:03:23.462630 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 118/253] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:23 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:23.479382 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5ddf9bbd-1f04-4f10-b753-7e3791e0a1a0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:23.480432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5ddf9bbd-1f04-4f10-b753-7e3791e0a1a0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:23.487306 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ddf9bbd-1f04-4f10-b753-7e3791e0a1a0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:23.487797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ddf9bbd-1f04-4f10-b753-7e3791e0a1a0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:23.488234 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ddf9bbd-1f04-4f10-b753-7e3791e0a1a0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:23.488928 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ddf9bbd-1f04-4f10-b753-7e3791e0a1a0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:23.489386 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ddf9bbd-1f04-4f10-b753-7e3791e0a1a0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:23.489813 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ddf9bbd-1f04-4f10-b753-7e3791e0a1a0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:23.514631 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5ddf9bbd-1f04-4f10-b753-7e3791e0a1a0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:03:23.582463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-520028c2-fe37-489f-aa68-fb629aa2534d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:23.583337 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-520028c2-fe37-489f-aa68-fb629aa2534d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:23.590627 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-520028c2-fe37-489f-aa68-fb629aa2534d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:23.591397 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-520028c2-fe37-489f-aa68-fb629aa2534d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:23.592375 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-520028c2-fe37-489f-aa68-fb629aa2534d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:23.593123 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-520028c2-fe37-489f-aa68-fb629aa2534d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:23.593583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-520028c2-fe37-489f-aa68-fb629aa2534d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:23.594296 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-520028c2-fe37-489f-aa68-fb629aa2534d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:23.615902 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5ddf9bbd-1f04-4f10-b753-7e3791e0a1a0 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "DELETE /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 204 len: 0 microversion: 2.1 time: 0.139524 Aug 29 19:03:23.622863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 136/254] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:03:23 2022] DELETE /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:03:23.633327 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-de374f6f-6331-457c-b55f-95804ac8261d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:23.634560 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-de374f6f-6331-457c-b55f-95804ac8261d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:23.651484 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de374f6f-6331-457c-b55f-95804ac8261d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:23.652694 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de374f6f-6331-457c-b55f-95804ac8261d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:23.653283 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de374f6f-6331-457c-b55f-95804ac8261d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:23.655070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de374f6f-6331-457c-b55f-95804ac8261d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:23.655674 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de374f6f-6331-457c-b55f-95804ac8261d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:23.662443 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de374f6f-6331-457c-b55f-95804ac8261d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:23.889603 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-520028c2-fe37-489f-aa68-fb629aa2534d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:23.902862 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-520028c2-fe37-489f-aa68-fb629aa2534d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.322003 Aug 29 19:03:23.906785 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 119/255] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:23 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:23.937482 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-de374f6f-6331-457c-b55f-95804ac8261d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:23.947108 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-de374f6f-6331-457c-b55f-95804ac8261d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1554 microversion: 2.1 time: 0.319871 Aug 29 19:03:23.948116 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 137/256] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:23 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1554 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:24.486830 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-495efe2f-55ac-4052-86a3-97d05d531ff2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:24.488557 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-495efe2f-55ac-4052-86a3-97d05d531ff2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:24.497587 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-495efe2f-55ac-4052-86a3-97d05d531ff2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:24.498964 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-495efe2f-55ac-4052-86a3-97d05d531ff2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:24.499563 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-495efe2f-55ac-4052-86a3-97d05d531ff2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:24.500550 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-495efe2f-55ac-4052-86a3-97d05d531ff2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:24.501556 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-495efe2f-55ac-4052-86a3-97d05d531ff2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:24.502195 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-495efe2f-55ac-4052-86a3-97d05d531ff2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:24.688455 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-495efe2f-55ac-4052-86a3-97d05d531ff2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:24.697202 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-495efe2f-55ac-4052-86a3-97d05d531ff2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1313 microversion: 2.1 time: 0.214570 Aug 29 19:03:24.698257 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 120/257] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:24 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:24.928017 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9a48e8fc-142e-4b2a-9213-7e18d5c6ba42 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:24.928625 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9a48e8fc-142e-4b2a-9213-7e18d5c6ba42 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:24.944980 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a48e8fc-142e-4b2a-9213-7e18d5c6ba42 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:24.945808 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a48e8fc-142e-4b2a-9213-7e18d5c6ba42 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:24.946501 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a48e8fc-142e-4b2a-9213-7e18d5c6ba42 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:24.947233 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a48e8fc-142e-4b2a-9213-7e18d5c6ba42 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:24.947691 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a48e8fc-142e-4b2a-9213-7e18d5c6ba42 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:24.948176 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a48e8fc-142e-4b2a-9213-7e18d5c6ba42 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:24.970419 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f0e57a0d-532c-4b93-af97-3e5c854bad5c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:24.970896 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f0e57a0d-532c-4b93-af97-3e5c854bad5c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:24.976900 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0e57a0d-532c-4b93-af97-3e5c854bad5c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:24.977386 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0e57a0d-532c-4b93-af97-3e5c854bad5c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:24.977794 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0e57a0d-532c-4b93-af97-3e5c854bad5c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:24.978651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0e57a0d-532c-4b93-af97-3e5c854bad5c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:24.979164 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0e57a0d-532c-4b93-af97-3e5c854bad5c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:24.979589 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0e57a0d-532c-4b93-af97-3e5c854bad5c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:25.139716 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9a48e8fc-142e-4b2a-9213-7e18d5c6ba42 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:25.149925 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9a48e8fc-142e-4b2a-9213-7e18d5c6ba42 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.225517 Aug 29 19:03:25.150549 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 138/258] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:24 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:25.174256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f0e57a0d-532c-4b93-af97-3e5c854bad5c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:25.182881 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f0e57a0d-532c-4b93-af97-3e5c854bad5c tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1554 microversion: 2.1 time: 0.216892 Aug 29 19:03:25.183476 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 121/259] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:24 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1554 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:25.723544 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3c38be58-8b04-4191-ae6f-d201e5337c7f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:25.725066 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3c38be58-8b04-4191-ae6f-d201e5337c7f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:25.731986 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c38be58-8b04-4191-ae6f-d201e5337c7f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:25.732761 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c38be58-8b04-4191-ae6f-d201e5337c7f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:25.733372 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c38be58-8b04-4191-ae6f-d201e5337c7f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:25.734245 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c38be58-8b04-4191-ae6f-d201e5337c7f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:25.734844 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c38be58-8b04-4191-ae6f-d201e5337c7f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:25.735432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c38be58-8b04-4191-ae6f-d201e5337c7f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:25.954025 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3c38be58-8b04-4191-ae6f-d201e5337c7f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:25.962324 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3c38be58-8b04-4191-ae6f-d201e5337c7f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1497 microversion: 2.1 time: 0.248292 Aug 29 19:03:25.962891 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 139/260] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:25 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1497 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:26.173150 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2c1355a7-1893-4141-9c8d-d5dc0f7a2417 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:26.173750 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2c1355a7-1893-4141-9c8d-d5dc0f7a2417 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:26.180924 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c1355a7-1893-4141-9c8d-d5dc0f7a2417 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:26.181703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c1355a7-1893-4141-9c8d-d5dc0f7a2417 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:26.182136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c1355a7-1893-4141-9c8d-d5dc0f7a2417 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:26.182823 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c1355a7-1893-4141-9c8d-d5dc0f7a2417 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:26.183313 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c1355a7-1893-4141-9c8d-d5dc0f7a2417 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:26.183724 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c1355a7-1893-4141-9c8d-d5dc0f7a2417 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:26.205899 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6c5d9e82-a6a0-4edf-97df-105e30c739f2 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:26.206513 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6c5d9e82-a6a0-4edf-97df-105e30c739f2 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:26.213463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c5d9e82-a6a0-4edf-97df-105e30c739f2 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:26.214163 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c5d9e82-a6a0-4edf-97df-105e30c739f2 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:26.214752 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c5d9e82-a6a0-4edf-97df-105e30c739f2 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:26.215683 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c5d9e82-a6a0-4edf-97df-105e30c739f2 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:26.216575 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c5d9e82-a6a0-4edf-97df-105e30c739f2 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:26.217876 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c5d9e82-a6a0-4edf-97df-105e30c739f2 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:26.414026 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2c1355a7-1893-4141-9c8d-d5dc0f7a2417 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:26.424448 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2c1355a7-1893-4141-9c8d-d5dc0f7a2417 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.255788 Aug 29 19:03:26.431145 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 122/261] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:26 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:26.493073 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6c5d9e82-a6a0-4edf-97df-105e30c739f2 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:26.501574 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6c5d9e82-a6a0-4edf-97df-105e30c739f2 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1554 microversion: 2.1 time: 0.301056 Aug 29 19:03:26.502151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 140/262] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:26 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1554 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:26.600098 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1a70e1f0-20e6-410b-9304-59a327a087fd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:26.600584 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1a70e1f0-20e6-410b-9304-59a327a087fd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:26.607097 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a70e1f0-20e6-410b-9304-59a327a087fd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:26.608210 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a70e1f0-20e6-410b-9304-59a327a087fd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:26.608633 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a70e1f0-20e6-410b-9304-59a327a087fd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:26.609353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a70e1f0-20e6-410b-9304-59a327a087fd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:26.609801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a70e1f0-20e6-410b-9304-59a327a087fd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:26.610216 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a70e1f0-20e6-410b-9304-59a327a087fd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:26.635409 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1a70e1f0-20e6-410b-9304-59a327a087fd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:03:26.738557 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1a70e1f0-20e6-410b-9304-59a327a087fd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "DELETE /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 204 len: 0 microversion: 2.1 time: 0.142218 Aug 29 19:03:26.739177 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 123/263] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:03:26 2022] DELETE /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:03:26.748381 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1a52fc29-39c9-449e-93ad-ffdc3d88680f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:26.749585 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1a52fc29-39c9-449e-93ad-ffdc3d88680f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:26.755550 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a52fc29-39c9-449e-93ad-ffdc3d88680f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:26.756142 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a52fc29-39c9-449e-93ad-ffdc3d88680f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:26.756582 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a52fc29-39c9-449e-93ad-ffdc3d88680f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:26.757352 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a52fc29-39c9-449e-93ad-ffdc3d88680f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:26.757984 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a52fc29-39c9-449e-93ad-ffdc3d88680f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:26.758407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a52fc29-39c9-449e-93ad-ffdc3d88680f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:26.983925 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1a52fc29-39c9-449e-93ad-ffdc3d88680f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:26.992677 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1a52fc29-39c9-449e-93ad-ffdc3d88680f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1503 microversion: 2.1 time: 0.248962 Aug 29 19:03:26.993318 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 141/264] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:26 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1503 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:27.447625 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3b6196cc-2d8f-4859-a548-e2520e7a35b6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:27.448420 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3b6196cc-2d8f-4859-a548-e2520e7a35b6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:27.456544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3b6196cc-2d8f-4859-a548-e2520e7a35b6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:27.457103 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3b6196cc-2d8f-4859-a548-e2520e7a35b6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:27.457626 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3b6196cc-2d8f-4859-a548-e2520e7a35b6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:27.458406 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3b6196cc-2d8f-4859-a548-e2520e7a35b6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:27.458934 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3b6196cc-2d8f-4859-a548-e2520e7a35b6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:27.459473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3b6196cc-2d8f-4859-a548-e2520e7a35b6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:27.522416 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5cc9487e-1efd-4962-9ff8-27a53f354613 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:27.523056 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5cc9487e-1efd-4962-9ff8-27a53f354613 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:27.529875 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5cc9487e-1efd-4962-9ff8-27a53f354613 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:27.530582 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5cc9487e-1efd-4962-9ff8-27a53f354613 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:27.531209 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5cc9487e-1efd-4962-9ff8-27a53f354613 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:27.532426 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5cc9487e-1efd-4962-9ff8-27a53f354613 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:27.533035 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5cc9487e-1efd-4962-9ff8-27a53f354613 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:27.533821 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5cc9487e-1efd-4962-9ff8-27a53f354613 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:27.641397 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3b6196cc-2d8f-4859-a548-e2520e7a35b6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:27.654705 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3b6196cc-2d8f-4859-a548-e2520e7a35b6 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.210745 Aug 29 19:03:27.659922 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 124/265] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:27 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:27.711244 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5cc9487e-1efd-4962-9ff8-27a53f354613 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:27.719658 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5cc9487e-1efd-4962-9ff8-27a53f354613 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1554 microversion: 2.1 time: 0.201889 Aug 29 19:03:27.720374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 142/266] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:27 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1554 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:28.013453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e28f8678-d1f5-4afe-a6bd-208d7aa208b5 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:28.014315 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e28f8678-d1f5-4afe-a6bd-208d7aa208b5 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:28.021308 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:28.023259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e28f8678-d1f5-4afe-a6bd-208d7aa208b5 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:28.024048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e28f8678-d1f5-4afe-a6bd-208d7aa208b5 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:28.024708 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e28f8678-d1f5-4afe-a6bd-208d7aa208b5 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:28.025648 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e28f8678-d1f5-4afe-a6bd-208d7aa208b5 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:28.026403 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e28f8678-d1f5-4afe-a6bd-208d7aa208b5 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:28.027362 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e28f8678-d1f5-4afe-a6bd-208d7aa208b5 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:28.170498 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e28f8678-d1f5-4afe-a6bd-208d7aa208b5 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:28.178858 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e28f8678-d1f5-4afe-a6bd-208d7aa208b5 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1503 microversion: 2.1 time: 0.169522 Aug 29 19:03:28.179466 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 125/267] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:28 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:28.691748 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4872ebcc-f2f3-4901-83a2-f5c2c867fc4d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:28.692448 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4872ebcc-f2f3-4901-83a2-f5c2c867fc4d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:28.698713 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4872ebcc-f2f3-4901-83a2-f5c2c867fc4d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:28.699328 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4872ebcc-f2f3-4901-83a2-f5c2c867fc4d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:28.699835 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4872ebcc-f2f3-4901-83a2-f5c2c867fc4d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:28.700635 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4872ebcc-f2f3-4901-83a2-f5c2c867fc4d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:28.701442 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4872ebcc-f2f3-4901-83a2-f5c2c867fc4d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:28.701938 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4872ebcc-f2f3-4901-83a2-f5c2c867fc4d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:28.741863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-40ec94db-ea0d-48a8-aebf-fd85face8826 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:28.742480 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-40ec94db-ea0d-48a8-aebf-fd85face8826 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:28.749922 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40ec94db-ea0d-48a8-aebf-fd85face8826 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:28.750428 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40ec94db-ea0d-48a8-aebf-fd85face8826 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:28.750857 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40ec94db-ea0d-48a8-aebf-fd85face8826 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:28.751593 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40ec94db-ea0d-48a8-aebf-fd85face8826 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:28.752045 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40ec94db-ea0d-48a8-aebf-fd85face8826 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:28.752675 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40ec94db-ea0d-48a8-aebf-fd85face8826 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:28.911100 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4872ebcc-f2f3-4901-83a2-f5c2c867fc4d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:28.922527 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4872ebcc-f2f3-4901-83a2-f5c2c867fc4d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.249303 Aug 29 19:03:28.924926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 143/268] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:28 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:28.993325 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-40ec94db-ea0d-48a8-aebf-fd85face8826 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:29.010174 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-40ec94db-ea0d-48a8-aebf-fd85face8826 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1554 microversion: 2.1 time: 0.272545 Aug 29 19:03:29.015137 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 126/269] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:28 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1554 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:29.202085 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-85c5e082-3b9b-4eb9-8896-54cdeda440b2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:29.202843 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-85c5e082-3b9b-4eb9-8896-54cdeda440b2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:29.215199 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85c5e082-3b9b-4eb9-8896-54cdeda440b2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:29.215681 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85c5e082-3b9b-4eb9-8896-54cdeda440b2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:29.216104 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85c5e082-3b9b-4eb9-8896-54cdeda440b2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:29.217017 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85c5e082-3b9b-4eb9-8896-54cdeda440b2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:29.217701 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85c5e082-3b9b-4eb9-8896-54cdeda440b2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:29.218341 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85c5e082-3b9b-4eb9-8896-54cdeda440b2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:29.244045 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-8b1cadf7-1b7c-48f8-8657-2e6f8f90abbc req-0896d74e-3a99-4724-80aa-d416d805f382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d18f21-f26a-4726-bd5e-a4d06d2c21b6", "name": "network-vif-deleted", "tag": "bb22b1e4-37ab-4211-b8c9-0eee1c7b0db7"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:03:29.267291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8b1cadf7-1b7c-48f8-8657-2e6f8f90abbc req-0896d74e-3a99-4724-80aa-d416d805f382 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:29.267997 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8b1cadf7-1b7c-48f8-8657-2e6f8f90abbc req-0896d74e-3a99-4724-80aa-d416d805f382 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:29.268689 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8b1cadf7-1b7c-48f8-8657-2e6f8f90abbc req-0896d74e-3a99-4724-80aa-d416d805f382 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:29.288043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-8b1cadf7-1b7c-48f8-8657-2e6f8f90abbc req-0896d74e-3a99-4724-80aa-d416d805f382 service nova] Creating event network-vif-deleted:bb22b1e4-37ab-4211-b8c9-0eee1c7b0db7 for instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 on hv-cinder-85083 Aug 29 19:03:29.300470 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-8b1cadf7-1b7c-48f8-8657-2e6f8f90abbc req-0896d74e-3a99-4724-80aa-d416d805f382 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060827 Aug 29 19:03:29.304217 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 127/270] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:03:29.755021 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-85c5e082-3b9b-4eb9-8896-54cdeda440b2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:29.765780 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-85c5e082-3b9b-4eb9-8896-54cdeda440b2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1503 microversion: 2.1 time: 0.569856 Aug 29 19:03:29.766803 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 144/271] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:29 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1503 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:29.946102 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-74f01d9a-6153-4f07-b7f8-541d96ce1394 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:29.947309 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-74f01d9a-6153-4f07-b7f8-541d96ce1394 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:29.954343 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-74f01d9a-6153-4f07-b7f8-541d96ce1394 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:29.954872 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-74f01d9a-6153-4f07-b7f8-541d96ce1394 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:29.955525 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-74f01d9a-6153-4f07-b7f8-541d96ce1394 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:29.956881 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-74f01d9a-6153-4f07-b7f8-541d96ce1394 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:29.957343 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-74f01d9a-6153-4f07-b7f8-541d96ce1394 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:29.957809 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-74f01d9a-6153-4f07-b7f8-541d96ce1394 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:29.980945 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:30.037660 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d4e92637-f9ed-4f1a-afd7-e9c1f930317f tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:30.039425 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d4e92637-f9ed-4f1a-afd7-e9c1f930317f tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:30.048169 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4e92637-f9ed-4f1a-afd7-e9c1f930317f tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:30.048583 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4e92637-f9ed-4f1a-afd7-e9c1f930317f tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:30.049054 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4e92637-f9ed-4f1a-afd7-e9c1f930317f tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:30.049761 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4e92637-f9ed-4f1a-afd7-e9c1f930317f tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:30.050381 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4e92637-f9ed-4f1a-afd7-e9c1f930317f tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:30.051052 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4e92637-f9ed-4f1a-afd7-e9c1f930317f tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:30.138621 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4e92637-f9ed-4f1a-afd7-e9c1f930317f tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:30.139529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4e92637-f9ed-4f1a-afd7-e9c1f930317f tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:30.140255 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4e92637-f9ed-4f1a-afd7-e9c1f930317f tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:30.140941 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-d4e92637-f9ed-4f1a-afd7-e9c1f930317f tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lazy-loading 'fault' on Instance uuid f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:03:30.158660 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-74f01d9a-6153-4f07-b7f8-541d96ce1394 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:30.167830 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-74f01d9a-6153-4f07-b7f8-541d96ce1394 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.227128 Aug 29 19:03:30.170979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 128/272] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:29 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:30.179853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-918d5045-fe3b-4f66-bd81-eca51bb9fa27 req-409a0286-6e9b-4ea8-8d4e-f214eb9973b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb66341-ca69-4bc3-84bc-4f44a8e429e1", "name": "network-vif-deleted", "tag": "18b2a31c-dd80-4597-beef-98ade3515d75"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:03:30.189915 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-918d5045-fe3b-4f66-bd81-eca51bb9fa27 req-409a0286-6e9b-4ea8-8d4e-f214eb9973b5 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:30.190508 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-918d5045-fe3b-4f66-bd81-eca51bb9fa27 req-409a0286-6e9b-4ea8-8d4e-f214eb9973b5 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:30.190934 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-918d5045-fe3b-4f66-bd81-eca51bb9fa27 req-409a0286-6e9b-4ea8-8d4e-f214eb9973b5 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:30.205665 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-918d5045-fe3b-4f66-bd81-eca51bb9fa27 req-409a0286-6e9b-4ea8-8d4e-f214eb9973b5 service nova] Creating event network-vif-deleted:18b2a31c-dd80-4597-beef-98ade3515d75 for instance 8eb66341-ca69-4bc3-84bc-4f44a8e429e1 on hv-cinder-85083 Aug 29 19:03:30.211297 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-918d5045-fe3b-4f66-bd81-eca51bb9fa27 req-409a0286-6e9b-4ea8-8d4e-f214eb9973b5 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034667 Aug 29 19:03:30.211452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d4e92637-f9ed-4f1a-afd7-e9c1f930317f tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:30.211894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 129/273] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:03:30.220973 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d4e92637-f9ed-4f1a-afd7-e9c1f930317f tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1351 microversion: 2.1 time: 0.187870 Aug 29 19:03:30.221555 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 145/274] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:30 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1351 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:30.788112 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ae6e1248-e400-422b-b1ff-5fdab7fea193 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:30.788790 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ae6e1248-e400-422b-b1ff-5fdab7fea193 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:30.794989 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae6e1248-e400-422b-b1ff-5fdab7fea193 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:30.795491 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae6e1248-e400-422b-b1ff-5fdab7fea193 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:30.795911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae6e1248-e400-422b-b1ff-5fdab7fea193 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:30.796581 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae6e1248-e400-422b-b1ff-5fdab7fea193 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:30.797021 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae6e1248-e400-422b-b1ff-5fdab7fea193 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:30.797431 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae6e1248-e400-422b-b1ff-5fdab7fea193 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:30.863456 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ae6e1248-e400-422b-b1ff-5fdab7fea193 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:30.871246 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ae6e1248-e400-422b-b1ff-5fdab7fea193 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1461 microversion: 2.1 time: 0.087287 Aug 29 19:03:30.871813 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 130/275] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:30 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1461 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:31.192469 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-68d67e6f-6874-4750-908e-1a917a86355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:31.193334 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-68d67e6f-6874-4750-908e-1a917a86355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:31.199586 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-68d67e6f-6874-4750-908e-1a917a86355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:31.200073 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-68d67e6f-6874-4750-908e-1a917a86355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:31.200509 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-68d67e6f-6874-4750-908e-1a917a86355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:31.201501 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-68d67e6f-6874-4750-908e-1a917a86355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:31.202075 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-68d67e6f-6874-4750-908e-1a917a86355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:31.202507 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-68d67e6f-6874-4750-908e-1a917a86355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:31.245167 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-31afae05-dfe0-4851-8c5f-8165ae7a6822 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:31.245784 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-31afae05-dfe0-4851-8c5f-8165ae7a6822 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:31.253958 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31afae05-dfe0-4851-8c5f-8165ae7a6822 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:31.254438 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31afae05-dfe0-4851-8c5f-8165ae7a6822 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:31.254876 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31afae05-dfe0-4851-8c5f-8165ae7a6822 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:31.255598 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31afae05-dfe0-4851-8c5f-8165ae7a6822 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:31.256046 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31afae05-dfe0-4851-8c5f-8165ae7a6822 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:31.256461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31afae05-dfe0-4851-8c5f-8165ae7a6822 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:31.291211 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31afae05-dfe0-4851-8c5f-8165ae7a6822 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:31.291711 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31afae05-dfe0-4851-8c5f-8165ae7a6822 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:31.292141 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31afae05-dfe0-4851-8c5f-8165ae7a6822 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:31.292597 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-31afae05-dfe0-4851-8c5f-8165ae7a6822 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lazy-loading 'fault' on Instance uuid f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:03:31.344432 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-31afae05-dfe0-4851-8c5f-8165ae7a6822 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:31.352589 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-31afae05-dfe0-4851-8c5f-8165ae7a6822 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1351 microversion: 2.1 time: 0.112031 Aug 29 19:03:31.353162 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 131/276] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:31 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:31.365541 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-68d67e6f-6874-4750-908e-1a917a86355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:31.373151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-68d67e6f-6874-4750-908e-1a917a86355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.184697 Aug 29 19:03:31.373703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 146/277] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:31 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:31.896456 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-332cc273-ce07-4bd5-88ab-a5c35269c70e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:31.897154 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-332cc273-ce07-4bd5-88ab-a5c35269c70e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:31.903543 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-332cc273-ce07-4bd5-88ab-a5c35269c70e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:31.904022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-332cc273-ce07-4bd5-88ab-a5c35269c70e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:31.905026 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-332cc273-ce07-4bd5-88ab-a5c35269c70e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:31.905712 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-332cc273-ce07-4bd5-88ab-a5c35269c70e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:31.906259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-332cc273-ce07-4bd5-88ab-a5c35269c70e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:31.906674 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-332cc273-ce07-4bd5-88ab-a5c35269c70e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:31.969110 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-332cc273-ce07-4bd5-88ab-a5c35269c70e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:31.976772 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-332cc273-ce07-4bd5-88ab-a5c35269c70e tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1298 microversion: 2.1 time: 0.087194 Aug 29 19:03:31.977336 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 132/278] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:31 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:32.373690 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c3992997-228e-49b1-ac3b-6b14aca10e71 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:32.374300 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c3992997-228e-49b1-ac3b-6b14aca10e71 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:32.380227 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c3992997-228e-49b1-ac3b-6b14aca10e71 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:32.380701 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c3992997-228e-49b1-ac3b-6b14aca10e71 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:32.381130 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c3992997-228e-49b1-ac3b-6b14aca10e71 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:32.381830 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c3992997-228e-49b1-ac3b-6b14aca10e71 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:32.382274 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c3992997-228e-49b1-ac3b-6b14aca10e71 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:32.382690 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c3992997-228e-49b1-ac3b-6b14aca10e71 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:32.394148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4e9c3773-2e0f-4926-a5dc-14e6853d3ccd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:32.394849 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4e9c3773-2e0f-4926-a5dc-14e6853d3ccd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:32.401227 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4e9c3773-2e0f-4926-a5dc-14e6853d3ccd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:32.401709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4e9c3773-2e0f-4926-a5dc-14e6853d3ccd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:32.402139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4e9c3773-2e0f-4926-a5dc-14e6853d3ccd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:32.402821 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4e9c3773-2e0f-4926-a5dc-14e6853d3ccd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:32.403560 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4e9c3773-2e0f-4926-a5dc-14e6853d3ccd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:32.404787 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4e9c3773-2e0f-4926-a5dc-14e6853d3ccd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:32.413076 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c3992997-228e-49b1-ac3b-6b14aca10e71 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:32.413556 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c3992997-228e-49b1-ac3b-6b14aca10e71 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:32.413988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c3992997-228e-49b1-ac3b-6b14aca10e71 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:32.414431 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-c3992997-228e-49b1-ac3b-6b14aca10e71 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lazy-loading 'fault' on Instance uuid f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:03:32.464649 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c3992997-228e-49b1-ac3b-6b14aca10e71 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:32.472977 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c3992997-228e-49b1-ac3b-6b14aca10e71 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1351 microversion: 2.1 time: 0.103671 Aug 29 19:03:32.473550 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 147/279] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:32 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:32.555974 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4e9c3773-2e0f-4926-a5dc-14e6853d3ccd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:32.564420 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4e9c3773-2e0f-4926-a5dc-14e6853d3ccd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.174081 Aug 29 19:03:32.564980 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 133/280] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:32 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:32.996974 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5226f2ff-97ee-4809-9f08-275bff5e01d1 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:32.997490 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5226f2ff-97ee-4809-9f08-275bff5e01d1 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:33.003380 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5226f2ff-97ee-4809-9f08-275bff5e01d1 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:33.003854 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5226f2ff-97ee-4809-9f08-275bff5e01d1 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:33.004285 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5226f2ff-97ee-4809-9f08-275bff5e01d1 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:33.004954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5226f2ff-97ee-4809-9f08-275bff5e01d1 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:33.005397 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5226f2ff-97ee-4809-9f08-275bff5e01d1 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:33.005809 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5226f2ff-97ee-4809-9f08-275bff5e01d1 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:33.065152 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5226f2ff-97ee-4809-9f08-275bff5e01d1 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:33.072981 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5226f2ff-97ee-4809-9f08-275bff5e01d1 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1298 microversion: 2.1 time: 0.079968 Aug 29 19:03:33.073534 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 148/281] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:32 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1298 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:33.493892 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2f5e59ce-ebe2-460f-bf6f-38a8b3594a0d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:33.494509 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2f5e59ce-ebe2-460f-bf6f-38a8b3594a0d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:33.501042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2f5e59ce-ebe2-460f-bf6f-38a8b3594a0d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:33.501531 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2f5e59ce-ebe2-460f-bf6f-38a8b3594a0d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:33.501967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2f5e59ce-ebe2-460f-bf6f-38a8b3594a0d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:33.502656 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2f5e59ce-ebe2-460f-bf6f-38a8b3594a0d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:33.503154 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2f5e59ce-ebe2-460f-bf6f-38a8b3594a0d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:33.503581 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2f5e59ce-ebe2-460f-bf6f-38a8b3594a0d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:33.535976 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2f5e59ce-ebe2-460f-bf6f-38a8b3594a0d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:33.536459 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2f5e59ce-ebe2-460f-bf6f-38a8b3594a0d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:33.536891 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2f5e59ce-ebe2-460f-bf6f-38a8b3594a0d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:33.537337 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-2f5e59ce-ebe2-460f-bf6f-38a8b3594a0d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lazy-loading 'fault' on Instance uuid f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:03:33.580292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2f5e59ce-ebe2-460f-bf6f-38a8b3594a0d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:33.585166 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0fcf385e-d977-4672-ae0f-bd1651c7f342 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:33.585818 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0fcf385e-d977-4672-ae0f-bd1651c7f342 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:33.588476 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2f5e59ce-ebe2-460f-bf6f-38a8b3594a0d tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1351 microversion: 2.1 time: 0.098416 Aug 29 19:03:33.589044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 134/282] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:33 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:33.592702 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0fcf385e-d977-4672-ae0f-bd1651c7f342 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:33.593265 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0fcf385e-d977-4672-ae0f-bd1651c7f342 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:33.593704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0fcf385e-d977-4672-ae0f-bd1651c7f342 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:33.594398 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0fcf385e-d977-4672-ae0f-bd1651c7f342 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:33.594853 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0fcf385e-d977-4672-ae0f-bd1651c7f342 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:33.595301 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0fcf385e-d977-4672-ae0f-bd1651c7f342 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:33.723207 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0fcf385e-d977-4672-ae0f-bd1651c7f342 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:33.725452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:33.732706 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0fcf385e-d977-4672-ae0f-bd1651c7f342 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.151537 Aug 29 19:03:33.733283 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 149/283] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:33 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:34.093945 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b9cf141c-9dc8-4b7e-9766-a393a7b74215 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:34.094551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b9cf141c-9dc8-4b7e-9766-a393a7b74215 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:34.100562 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9cf141c-9dc8-4b7e-9766-a393a7b74215 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:34.101049 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9cf141c-9dc8-4b7e-9766-a393a7b74215 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:34.101509 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9cf141c-9dc8-4b7e-9766-a393a7b74215 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:34.102191 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9cf141c-9dc8-4b7e-9766-a393a7b74215 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:34.102641 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9cf141c-9dc8-4b7e-9766-a393a7b74215 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:34.103123 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9cf141c-9dc8-4b7e-9766-a393a7b74215 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:34.167322 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b9cf141c-9dc8-4b7e-9766-a393a7b74215 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:34.176125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b9cf141c-9dc8-4b7e-9766-a393a7b74215 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1298 microversion: 2.1 time: 0.086002 Aug 29 19:03:34.176699 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 135/284] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:34 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:34.609286 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-60cce1f3-caa3-4242-8696-52a0f056923e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:34.609895 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-60cce1f3-caa3-4242-8696-52a0f056923e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:34.617435 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-60cce1f3-caa3-4242-8696-52a0f056923e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:34.617919 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-60cce1f3-caa3-4242-8696-52a0f056923e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:34.618352 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-60cce1f3-caa3-4242-8696-52a0f056923e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:34.619060 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-60cce1f3-caa3-4242-8696-52a0f056923e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:34.619513 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-60cce1f3-caa3-4242-8696-52a0f056923e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:34.619933 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-60cce1f3-caa3-4242-8696-52a0f056923e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:34.649890 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-60cce1f3-caa3-4242-8696-52a0f056923e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:34.650293 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-60cce1f3-caa3-4242-8696-52a0f056923e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:34.650718 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-60cce1f3-caa3-4242-8696-52a0f056923e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:34.651183 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-60cce1f3-caa3-4242-8696-52a0f056923e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lazy-loading 'fault' on Instance uuid f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:03:34.691999 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-60cce1f3-caa3-4242-8696-52a0f056923e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5598718e51df4a7c92ef828de3003dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6272dcd88f47abb7a514070aaaccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:34.700828 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-60cce1f3-caa3-4242-8696-52a0f056923e tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 200 len: 1351 microversion: 2.1 time: 0.095793 Aug 29 19:03:34.701586 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 150/285] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:34 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 1351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:34.754927 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6ef4f60f-aac2-4ce0-9687-5dd7830764a9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:34.755719 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6ef4f60f-aac2-4ce0-9687-5dd7830764a9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:34.762462 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ef4f60f-aac2-4ce0-9687-5dd7830764a9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:34.763165 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ef4f60f-aac2-4ce0-9687-5dd7830764a9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:34.764327 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ef4f60f-aac2-4ce0-9687-5dd7830764a9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:34.765147 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ef4f60f-aac2-4ce0-9687-5dd7830764a9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:34.765670 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ef4f60f-aac2-4ce0-9687-5dd7830764a9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:34.766179 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ef4f60f-aac2-4ce0-9687-5dd7830764a9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:35.042172 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6ef4f60f-aac2-4ce0-9687-5dd7830764a9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:35.049851 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6ef4f60f-aac2-4ce0-9687-5dd7830764a9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.299527 Aug 29 19:03:35.050408 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 136/286] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:34 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:35.196968 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2a31e226-2acf-4af9-b2ed-7e7e13564818 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:35.197484 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2a31e226-2acf-4af9-b2ed-7e7e13564818 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:35.204025 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a31e226-2acf-4af9-b2ed-7e7e13564818 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:35.204506 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a31e226-2acf-4af9-b2ed-7e7e13564818 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:35.204950 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a31e226-2acf-4af9-b2ed-7e7e13564818 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:35.205603 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a31e226-2acf-4af9-b2ed-7e7e13564818 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:35.206046 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a31e226-2acf-4af9-b2ed-7e7e13564818 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:35.206460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a31e226-2acf-4af9-b2ed-7e7e13564818 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:35.235509 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a31e226-2acf-4af9-b2ed-7e7e13564818 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:35.235971 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a31e226-2acf-4af9-b2ed-7e7e13564818 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:35.236398 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a31e226-2acf-4af9-b2ed-7e7e13564818 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:35.236830 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-2a31e226-2acf-4af9-b2ed-7e7e13564818 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lazy-loading 'fault' on Instance uuid 8eb66341-ca69-4bc3-84bc-4f44a8e429e1 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:03:35.277329 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2a31e226-2acf-4af9-b2ed-7e7e13564818 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:35.285100 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2a31e226-2acf-4af9-b2ed-7e7e13564818 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 200 len: 1303 microversion: 2.1 time: 0.092274 Aug 29 19:03:35.285855 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 151/287] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:35 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:35.720999 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-81ad8de0-b3d5-40e0-8450-87a5b5dcfe6a tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:35.721840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-81ad8de0-b3d5-40e0-8450-87a5b5dcfe6a tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:35.728095 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81ad8de0-b3d5-40e0-8450-87a5b5dcfe6a tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:35.728588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81ad8de0-b3d5-40e0-8450-87a5b5dcfe6a tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:35.729021 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81ad8de0-b3d5-40e0-8450-87a5b5dcfe6a tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:35.729718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81ad8de0-b3d5-40e0-8450-87a5b5dcfe6a tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:35.730165 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81ad8de0-b3d5-40e0-8450-87a5b5dcfe6a tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:35.730583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81ad8de0-b3d5-40e0-8450-87a5b5dcfe6a tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:35.744409 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-81ad8de0-b3d5-40e0-8450-87a5b5dcfe6a tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] HTTP exception thrown: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-81ad8de0-b3d5-40e0-8450-87a5b5dcfe6a tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Request method failure captured: Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 HTTP/1.1 Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0curqA1dsEN_hnmc2pNJftp2BaLfmW9NTiM-fGqRpGf2xCLQnmrPjEGN0TUF0gt3_KSr_lO3HdCorws0v4ce-380fpwxk8OGAPmkeP99mnUv87ta3HC8jhDIVqEX3AfrVPzgESWuVL-ah15EKElgtEhZWkgNPaiiaqFggacK8Nyz4 Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 4c6272dcd88f47abb7a514070aaaccd3 Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-DeleteServersTestJSON-968452591 Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:03:35.750013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:03:35.751461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4c6272dcd88f47abb7a514070aaaccd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4c6272dcd88f47abb7a514070aaaccd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/4c6272dcd88f47abb7a514070aaaccd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_4c6272dcd88f47abb7a514070aaaccd3"}]}] Aug 29 19:03:35.751461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-DeleteServersTestJSON-968452591 Aug 29 19:03:35.751461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 4c6272dcd88f47abb7a514070aaaccd3 Aug 29 19:03:35.751461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-DeleteServersTestJSON-968452591 Aug 29 19:03:35.751461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-DeleteServersTestJSON-968452591-project Aug 29 19:03:35.751461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:03:35.751461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:03:35.751461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: 5598718e51df4a7c92ef828de3003dc7 Aug 29 19:03:35.751461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-DeleteServersTestJSON-968452591-project Aug 29 19:03:35.751461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:03:35.751461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:35.751461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': 'f6d18f21-f26a-4726-bd5e-a4d06d2c21b6'} Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:03:35.752285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:35.753713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:03:35.754941 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-81ad8de0-b3d5-40e0-8450-87a5b5dcfe6a tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Returning 404 to user: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:03:35.754941 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-81ad8de0-b3d5-40e0-8450-87a5b5dcfe6a tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 404 len: 111 microversion: 2.1 time: 0.034324 Aug 29 19:03:35.755572 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 137/288] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:35 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:03:35.870729 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cca687d0-5fe9-4687-a098-08b2785e9b27 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:35.873222 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cca687d0-5fe9-4687-a098-08b2785e9b27 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:35.879467 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cca687d0-5fe9-4687-a098-08b2785e9b27 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:35.880050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cca687d0-5fe9-4687-a098-08b2785e9b27 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:35.880545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cca687d0-5fe9-4687-a098-08b2785e9b27 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:35.881295 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cca687d0-5fe9-4687-a098-08b2785e9b27 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:35.881810 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cca687d0-5fe9-4687-a098-08b2785e9b27 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:35.882296 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cca687d0-5fe9-4687-a098-08b2785e9b27 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:35.896036 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-cca687d0-5fe9-4687-a098-08b2785e9b27 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] HTTP exception thrown: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cca687d0-5fe9-4687-a098-08b2785e9b27 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Request method failure captured: Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6/os-volume_attachments HTTP/1.1 Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ0curqA1dsEN_hnmc2pNJftp2BaLfmW9NTiM-fGqRpGf2xCLQnmrPjEGN0TUF0gt3_KSr_lO3HdCorws0v4ce-380fpwxk8OGAPmkeP99mnUv87ta3HC8jhDIVqEX3AfrVPzgESWuVL-ah15EKElgtEhZWkgNPaiiaqFggacK8Nyz4 Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: 4c6272dcd88f47abb7a514070aaaccd3 Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-DeleteServersTestJSON-968452591 Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:03:35.902749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:03:35.904699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4c6272dcd88f47abb7a514070aaaccd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4c6272dcd88f47abb7a514070aaaccd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/4c6272dcd88f47abb7a514070aaaccd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_4c6272dcd88f47abb7a514070aaaccd3"}]}] Aug 29 19:03:35.904699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-DeleteServersTestJSON-968452591 Aug 29 19:03:35.904699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 4c6272dcd88f47abb7a514070aaaccd3 Aug 29 19:03:35.904699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-DeleteServersTestJSON-968452591 Aug 29 19:03:35.904699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-DeleteServersTestJSON-968452591-project Aug 29 19:03:35.904699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:03:35.904699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:03:35.904699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: 5598718e51df4a7c92ef828de3003dc7 Aug 29 19:03:35.904699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-DeleteServersTestJSON-968452591-project Aug 29 19:03:35.904699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:03:35.904699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:35.904699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'server_id': 'f6d18f21-f26a-4726-bd5e-a4d06d2c21b6'} Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:03:35.905463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:35.906529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:03:35.908050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cca687d0-5fe9-4687-a098-08b2785e9b27 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Returning 404 to user: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:03:35.908050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cca687d0-5fe9-4687-a098-08b2785e9b27 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037647 Aug 29 19:03:35.908050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 152/289] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:03:35 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:03:36.072112 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f080548a-5bde-434f-9173-1ce762cec16c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:36.073308 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f080548a-5bde-434f-9173-1ce762cec16c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:36.081425 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f080548a-5bde-434f-9173-1ce762cec16c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:36.082277 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f080548a-5bde-434f-9173-1ce762cec16c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:36.083928 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f080548a-5bde-434f-9173-1ce762cec16c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:36.084657 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f080548a-5bde-434f-9173-1ce762cec16c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:36.085122 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f080548a-5bde-434f-9173-1ce762cec16c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:36.085548 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f080548a-5bde-434f-9173-1ce762cec16c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:36.224840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f080548a-5bde-434f-9173-1ce762cec16c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:36.232793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f080548a-5bde-434f-9173-1ce762cec16c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.165695 Aug 29 19:03:36.233789 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 138/290] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:36 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:36.306023 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-49fa549a-1d5a-416e-a2cf-1f61bdf1dd83 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:36.306630 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-49fa549a-1d5a-416e-a2cf-1f61bdf1dd83 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 8eb66341-ca69-4bc3-84bc-4f44a8e429e1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:36.312671 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49fa549a-1d5a-416e-a2cf-1f61bdf1dd83 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:36.313150 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49fa549a-1d5a-416e-a2cf-1f61bdf1dd83 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:36.313581 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49fa549a-1d5a-416e-a2cf-1f61bdf1dd83 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:36.314263 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49fa549a-1d5a-416e-a2cf-1f61bdf1dd83 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:36.314711 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49fa549a-1d5a-416e-a2cf-1f61bdf1dd83 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:36.315166 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49fa549a-1d5a-416e-a2cf-1f61bdf1dd83 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:36.329522 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-49fa549a-1d5a-416e-a2cf-1f61bdf1dd83 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] HTTP exception thrown: Instance 8eb66341-ca69-4bc3-84bc-4f44a8e429e1 could not be found. Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-49fa549a-1d5a-416e-a2cf-1f61bdf1dd83 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Request method failure captured: Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 HTTP/1.1 Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ1XhW7u5DVA5ZQs4z1HqeNO7gAPR-qYntRpZ6p-_tzyNHAArRhnpwnlDtBs-baegnVpCcJ3j54YeyzIM0Y15f2bBZojiTIq4LXcsddEtrcSCSQfNwC4JJfxAs6u9t6Z1Mr8qDXh8JB-QRuJO7v1C_y1Nuv63GjQzMnWoTALUO4Y8Ro Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: cbf40ccacdc74575909f541214adf6f7 Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-VolumesActionsTest-605021643 Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:03:36.331764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:03:36.333203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/cbf40ccacdc74575909f541214adf6f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/cbf40ccacdc74575909f541214adf6f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/cbf40ccacdc74575909f541214adf6f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_cbf40ccacdc74575909f541214adf6f7"}]}] Aug 29 19:03:36.333203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-VolumesActionsTest-605021643 Aug 29 19:03:36.333203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: cbf40ccacdc74575909f541214adf6f7 Aug 29 19:03:36.333203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-VolumesActionsTest-605021643 Aug 29 19:03:36.333203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-VolumesActionsTest-605021643-project Aug 29 19:03:36.333203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:03:36.333203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:03:36.333203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: 41227378a57c43219e4ae460c642f834 Aug 29 19:03:36.333203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-VolumesActionsTest-605021643-project Aug 29 19:03:36.333203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:03:36.333203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance 8eb66341-ca69-4bc3-84bc-4f44a8e429e1 could not be found. Aug 29 19:03:36.333203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': '8eb66341-ca69-4bc3-84bc-4f44a8e429e1'} Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eb66341-ca69-4bc3-84bc-4f44a8e429e1 could not be found. Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:03:36.334048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eb66341-ca69-4bc3-84bc-4f44a8e429e1 could not be found. Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eb66341-ca69-4bc3-84bc-4f44a8e429e1 could not be found. Aug 29 19:03:36.335287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:03:36.336403 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-49fa549a-1d5a-416e-a2cf-1f61bdf1dd83 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Returning 404 to user: Instance 8eb66341-ca69-4bc3-84bc-4f44a8e429e1 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:03:36.336403 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-49fa549a-1d5a-416e-a2cf-1f61bdf1dd83 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1" status: 404 len: 111 microversion: 2.1 time: 0.031145 Aug 29 19:03:36.336403 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 153/291] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:36 2022] GET /compute/v2.1/servers/8eb66341-ca69-4bc3-84bc-4f44a8e429e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:03:36.437228 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-460577503", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452", "networks": [{"uuid": "44f8d360-5ca3-4012-b017-b14c9f8ccbad"}]}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:03:36.491070 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] validate_networks() for [('44f8d360-5ca3-4012-b017-b14c9f8ccbad', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:03:36.874785 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:03:36.874785 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:03:36.874785 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:03:36.874785 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:03:36.874785 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:03:36.881873 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:36.882424 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:36.882852 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:36.883634 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:36.884106 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:36.884535 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:36.901774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Getting quotas for project cbf40ccacdc74575909f541214adf6f7. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:03:36.906371 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Getting quotas for user 41227378a57c43219e4ae460c642f834 and project cbf40ccacdc74575909f541214adf6f7. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:03:36.918504 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:03:36.921952 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:03:36.970486 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-036428ef-302d-429b-b8b5-89808c9ae060 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537337 Aug 29 19:03:36.971331 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 139/292] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:03:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:03:36.983066 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d2949d9b-8c34-4546-bb3c-57dd62e98eb5 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:36.984306 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d2949d9b-8c34-4546-bb3c-57dd62e98eb5 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:37.054322 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d2949d9b-8c34-4546-bb3c-57dd62e98eb5 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:37.061440 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d2949d9b-8c34-4546-bb3c-57dd62e98eb5 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1213 microversion: 2.1 time: 0.083105 Aug 29 19:03:37.062088 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 154/293] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:36 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:37.150518 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0f0e3e8a-f29b-4d95-b97e-884feaf0c57b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:37.151032 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0f0e3e8a-f29b-4d95-b97e-884feaf0c57b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:37.158903 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f0e3e8a-f29b-4d95-b97e-884feaf0c57b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:37.159441 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f0e3e8a-f29b-4d95-b97e-884feaf0c57b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:37.159872 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f0e3e8a-f29b-4d95-b97e-884feaf0c57b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:37.160566 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f0e3e8a-f29b-4d95-b97e-884feaf0c57b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:37.161020 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f0e3e8a-f29b-4d95-b97e-884feaf0c57b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:37.161432 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f0e3e8a-f29b-4d95-b97e-884feaf0c57b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:37.176881 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-0f0e3e8a-f29b-4d95-b97e-884feaf0c57b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] HTTP exception thrown: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0f0e3e8a-f29b-4d95-b97e-884feaf0c57b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Request method failure captured: Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: DELETE /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 HTTP/1.1 Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0curqA1dsEN_hnmc2pNJftp2BaLfmW9NTiM-fGqRpGf2xCLQnmrPjEGN0TUF0gt3_KSr_lO3HdCorws0v4ce-380fpwxk8OGAPmkeP99mnUv87ta3HC8jhDIVqEX3AfrVPzgESWuVL-ah15EKElgtEhZWkgNPaiiaqFggacK8Nyz4 Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 4c6272dcd88f47abb7a514070aaaccd3 Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-DeleteServersTestJSON-968452591 Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:03:37.178473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:03:37.190073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4c6272dcd88f47abb7a514070aaaccd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4c6272dcd88f47abb7a514070aaaccd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/4c6272dcd88f47abb7a514070aaaccd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_4c6272dcd88f47abb7a514070aaaccd3"}]}] Aug 29 19:03:37.190073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-DeleteServersTestJSON-968452591 Aug 29 19:03:37.190073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 4c6272dcd88f47abb7a514070aaaccd3 Aug 29 19:03:37.190073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-DeleteServersTestJSON-968452591 Aug 29 19:03:37.190073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-DeleteServersTestJSON-968452591-project Aug 29 19:03:37.190073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:03:37.190073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:03:37.190073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: 5598718e51df4a7c92ef828de3003dc7 Aug 29 19:03:37.190073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-DeleteServersTestJSON-968452591-project Aug 29 19:03:37.190073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:03:37.190073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:37.190073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': 'f6d18f21-f26a-4726-bd5e-a4d06d2c21b6'} Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:03:37.191453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:37.193591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:03:37.194904 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0f0e3e8a-f29b-4d95-b97e-884feaf0c57b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Returning 404 to user: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:03:37.194904 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0f0e3e8a-f29b-4d95-b97e-884feaf0c57b tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "DELETE /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 404 len: 111 microversion: 2.1 time: 0.033170 Aug 29 19:03:37.194904 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 140/294] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:03:37 2022] DELETE /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:03:37.195747 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e648e2fc-3d18-4e37-a019-b6419b8c4fc9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:37.195949 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e648e2fc-3d18-4e37-a019-b6419b8c4fc9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] [instance: f6d18f21-f26a-4726-bd5e-a4d06d2c21b6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:37.206651 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e648e2fc-3d18-4e37-a019-b6419b8c4fc9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:37.207474 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e648e2fc-3d18-4e37-a019-b6419b8c4fc9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:37.208077 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e648e2fc-3d18-4e37-a019-b6419b8c4fc9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:37.208956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e648e2fc-3d18-4e37-a019-b6419b8c4fc9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:37.209582 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e648e2fc-3d18-4e37-a019-b6419b8c4fc9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:37.210317 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e648e2fc-3d18-4e37-a019-b6419b8c4fc9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:37.227475 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-e648e2fc-3d18-4e37-a019-b6419b8c4fc9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] HTTP exception thrown: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e648e2fc-3d18-4e37-a019-b6419b8c4fc9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Request method failure captured: Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 HTTP/1.1 Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ0curqA1dsEN_hnmc2pNJftp2BaLfmW9NTiM-fGqRpGf2xCLQnmrPjEGN0TUF0gt3_KSr_lO3HdCorws0v4ce-380fpwxk8OGAPmkeP99mnUv87ta3HC8jhDIVqEX3AfrVPzgESWuVL-ah15EKElgtEhZWkgNPaiiaqFggacK8Nyz4 Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: 4c6272dcd88f47abb7a514070aaaccd3 Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-DeleteServersTestJSON-968452591 Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:03:37.229044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:03:37.230457 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4c6272dcd88f47abb7a514070aaaccd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4c6272dcd88f47abb7a514070aaaccd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/4c6272dcd88f47abb7a514070aaaccd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_4c6272dcd88f47abb7a514070aaaccd3"}]}] Aug 29 19:03:37.230457 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-DeleteServersTestJSON-968452591 Aug 29 19:03:37.230457 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 4c6272dcd88f47abb7a514070aaaccd3 Aug 29 19:03:37.230457 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-DeleteServersTestJSON-968452591 Aug 29 19:03:37.230457 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-DeleteServersTestJSON-968452591-project Aug 29 19:03:37.230457 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:03:37.230457 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:03:37.230457 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: 5598718e51df4a7c92ef828de3003dc7 Aug 29 19:03:37.230457 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-DeleteServersTestJSON-968452591-project Aug 29 19:03:37.230457 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:03:37.230457 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:37.230457 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': 'f6d18f21-f26a-4726-bd5e-a4d06d2c21b6'} Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:03:37.231248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. Aug 29 19:03:37.232374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:03:37.233483 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e648e2fc-3d18-4e37-a019-b6419b8c4fc9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] Returning 404 to user: Instance f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:03:37.233483 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e648e2fc-3d18-4e37-a019-b6419b8c4fc9 tempest-DeleteServersTestJSON-968452591 tempest-DeleteServersTestJSON-968452591-project] 10.222.0.86 "GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6" status: 404 len: 111 microversion: 2.1 time: 0.042008 Aug 29 19:03:37.233483 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 155/295] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:37 2022] GET /compute/v2.1/servers/f6d18f21-f26a-4726-bd5e-a4d06d2c21b6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:03:37.254866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-28b83c93-0eb4-4556-987a-e12b1bf3fae8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:37.255675 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-28b83c93-0eb4-4556-987a-e12b1bf3fae8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:37.269115 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28b83c93-0eb4-4556-987a-e12b1bf3fae8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:37.269889 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28b83c93-0eb4-4556-987a-e12b1bf3fae8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:37.270324 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28b83c93-0eb4-4556-987a-e12b1bf3fae8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:37.271058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28b83c93-0eb4-4556-987a-e12b1bf3fae8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:37.271513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28b83c93-0eb4-4556-987a-e12b1bf3fae8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:37.271932 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28b83c93-0eb4-4556-987a-e12b1bf3fae8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:37.484996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-28b83c93-0eb4-4556-987a-e12b1bf3fae8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:37.492855 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-28b83c93-0eb4-4556-987a-e12b1bf3fae8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.242264 Aug 29 19:03:37.493434 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 141/296] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:37 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:38.084614 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a230d7a4-a242-4899-91c2-87fa5acdf8dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:38.085366 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a230d7a4-a242-4899-91c2-87fa5acdf8dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:38.092354 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a230d7a4-a242-4899-91c2-87fa5acdf8dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:38.092899 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a230d7a4-a242-4899-91c2-87fa5acdf8dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:38.093573 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a230d7a4-a242-4899-91c2-87fa5acdf8dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:38.094604 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a230d7a4-a242-4899-91c2-87fa5acdf8dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:38.095177 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a230d7a4-a242-4899-91c2-87fa5acdf8dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:38.095766 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a230d7a4-a242-4899-91c2-87fa5acdf8dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:38.185627 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a230d7a4-a242-4899-91c2-87fa5acdf8dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:38.194488 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a230d7a4-a242-4899-91c2-87fa5acdf8dd tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1265 microversion: 2.1 time: 0.115071 Aug 29 19:03:38.208037 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 156/297] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:38 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1265 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:38.515330 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f216bf21-96c4-49a4-9d7a-7169c277019b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:38.515949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f216bf21-96c4-49a4-9d7a-7169c277019b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:38.525797 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f216bf21-96c4-49a4-9d7a-7169c277019b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:38.526843 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f216bf21-96c4-49a4-9d7a-7169c277019b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:38.527765 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f216bf21-96c4-49a4-9d7a-7169c277019b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:38.528809 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f216bf21-96c4-49a4-9d7a-7169c277019b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:38.530410 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f216bf21-96c4-49a4-9d7a-7169c277019b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:38.531260 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f216bf21-96c4-49a4-9d7a-7169c277019b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:38.708808 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f216bf21-96c4-49a4-9d7a-7169c277019b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:38.718406 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f216bf21-96c4-49a4-9d7a-7169c277019b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.208405 Aug 29 19:03:38.718985 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 142/298] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:38 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:39.218019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b355ff8e-60a4-4241-8545-d9771c258c62 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:39.219396 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b355ff8e-60a4-4241-8545-d9771c258c62 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:39.221590 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:39.229058 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b355ff8e-60a4-4241-8545-d9771c258c62 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:39.230163 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b355ff8e-60a4-4241-8545-d9771c258c62 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:39.231092 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b355ff8e-60a4-4241-8545-d9771c258c62 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:39.234204 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b355ff8e-60a4-4241-8545-d9771c258c62 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:39.235079 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b355ff8e-60a4-4241-8545-d9771c258c62 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:39.235827 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b355ff8e-60a4-4241-8545-d9771c258c62 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:39.361372 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b355ff8e-60a4-4241-8545-d9771c258c62 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:39.371982 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b355ff8e-60a4-4241-8545-d9771c258c62 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1271 microversion: 2.1 time: 0.158483 Aug 29 19:03:39.372476 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 157/299] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:39 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:39.739462 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a83cc3b5-7653-4f53-9a4b-459766243749 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:39.740068 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a83cc3b5-7653-4f53-9a4b-459766243749 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:39.747168 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a83cc3b5-7653-4f53-9a4b-459766243749 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:39.752897 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a83cc3b5-7653-4f53-9a4b-459766243749 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:39.753580 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a83cc3b5-7653-4f53-9a4b-459766243749 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:39.755663 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a83cc3b5-7653-4f53-9a4b-459766243749 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:39.757777 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a83cc3b5-7653-4f53-9a4b-459766243749 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:39.758237 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a83cc3b5-7653-4f53-9a4b-459766243749 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:40.026587 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a83cc3b5-7653-4f53-9a4b-459766243749 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:40.035722 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a83cc3b5-7653-4f53-9a4b-459766243749 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.300071 Aug 29 19:03:40.040769 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 143/300] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:39 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:40.394546 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9c558ce5-c070-456d-95ee-15d6d86bd461 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:40.395748 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9c558ce5-c070-456d-95ee-15d6d86bd461 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:40.403188 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c558ce5-c070-456d-95ee-15d6d86bd461 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:40.404042 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c558ce5-c070-456d-95ee-15d6d86bd461 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:40.404656 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c558ce5-c070-456d-95ee-15d6d86bd461 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:40.405530 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c558ce5-c070-456d-95ee-15d6d86bd461 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:40.406272 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c558ce5-c070-456d-95ee-15d6d86bd461 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:40.406853 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c558ce5-c070-456d-95ee-15d6d86bd461 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:40.752937 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9c558ce5-c070-456d-95ee-15d6d86bd461 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:40.764969 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9c558ce5-c070-456d-95ee-15d6d86bd461 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1313 microversion: 2.1 time: 0.374161 Aug 29 19:03:40.778482 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 158/301] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:40 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:41.073806 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ba184fb0-9539-4616-8fb1-864abf32152e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:41.075265 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ba184fb0-9539-4616-8fb1-864abf32152e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:41.085952 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba184fb0-9539-4616-8fb1-864abf32152e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:41.088735 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba184fb0-9539-4616-8fb1-864abf32152e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:41.089372 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba184fb0-9539-4616-8fb1-864abf32152e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:41.094056 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba184fb0-9539-4616-8fb1-864abf32152e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:41.094874 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba184fb0-9539-4616-8fb1-864abf32152e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:41.095470 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba184fb0-9539-4616-8fb1-864abf32152e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:41.622779 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ba184fb0-9539-4616-8fb1-864abf32152e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:41.634703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ba184fb0-9539-4616-8fb1-864abf32152e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.565367 Aug 29 19:03:41.639188 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 144/302] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:41 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:41.677943 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-329119f2-f374-439d-8820-b707d2c4d84a req-57f8c3ec-f0fc-44e2-956c-25fa6ff0c94d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5acb2fcc-1d17-4659-b924-2e3e27e17794", "tag": "9f8e67cf-33e9-4998-ae61-ac90f0995685"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:03:41.695621 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-329119f2-f374-439d-8820-b707d2c4d84a req-57f8c3ec-f0fc-44e2-956c-25fa6ff0c94d service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:41.696338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-329119f2-f374-439d-8820-b707d2c4d84a req-57f8c3ec-f0fc-44e2-956c-25fa6ff0c94d service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:41.696971 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-329119f2-f374-439d-8820-b707d2c4d84a req-57f8c3ec-f0fc-44e2-956c-25fa6ff0c94d service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:41.715575 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-329119f2-f374-439d-8820-b707d2c4d84a req-57f8c3ec-f0fc-44e2-956c-25fa6ff0c94d service nova] Creating event network-changed:9f8e67cf-33e9-4998-ae61-ac90f0995685 for instance 5acb2fcc-1d17-4659-b924-2e3e27e17794 on hv-cinder-85083 Aug 29 19:03:41.723065 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-329119f2-f374-439d-8820-b707d2c4d84a req-57f8c3ec-f0fc-44e2-956c-25fa6ff0c94d service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050698 Aug 29 19:03:41.724970 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 159/303] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:03:41.786530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-06723b37-2bf4-4970-b345-a6f813f04959 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:41.789047 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-06723b37-2bf4-4970-b345-a6f813f04959 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:41.796385 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06723b37-2bf4-4970-b345-a6f813f04959 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:41.797076 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06723b37-2bf4-4970-b345-a6f813f04959 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:41.797510 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06723b37-2bf4-4970-b345-a6f813f04959 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:41.798962 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06723b37-2bf4-4970-b345-a6f813f04959 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:41.799445 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06723b37-2bf4-4970-b345-a6f813f04959 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:41.799878 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06723b37-2bf4-4970-b345-a6f813f04959 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:42.055648 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-06723b37-2bf4-4970-b345-a6f813f04959 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:42.067559 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-06723b37-2bf4-4970-b345-a6f813f04959 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1313 microversion: 2.1 time: 0.284609 Aug 29 19:03:42.069003 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 145/304] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:41 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:42.666640 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2e3f6522-c8e0-4418-adc9-f9e65956b41e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:42.668037 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2e3f6522-c8e0-4418-adc9-f9e65956b41e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:42.675959 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3f6522-c8e0-4418-adc9-f9e65956b41e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:42.676481 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3f6522-c8e0-4418-adc9-f9e65956b41e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:42.677017 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3f6522-c8e0-4418-adc9-f9e65956b41e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:42.677849 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3f6522-c8e0-4418-adc9-f9e65956b41e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:42.678306 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3f6522-c8e0-4418-adc9-f9e65956b41e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:42.678824 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3f6522-c8e0-4418-adc9-f9e65956b41e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:42.839170 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2e3f6522-c8e0-4418-adc9-f9e65956b41e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:42.848622 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2e3f6522-c8e0-4418-adc9-f9e65956b41e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.192257 Aug 29 19:03:42.859249 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 160/305] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:42 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:43.093830 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4aea2d24-f0f3-4070-a3ec-5842ffe60435 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:43.094521 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4aea2d24-f0f3-4070-a3ec-5842ffe60435 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:43.101728 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4aea2d24-f0f3-4070-a3ec-5842ffe60435 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:43.102442 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4aea2d24-f0f3-4070-a3ec-5842ffe60435 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:43.103229 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4aea2d24-f0f3-4070-a3ec-5842ffe60435 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:43.103933 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4aea2d24-f0f3-4070-a3ec-5842ffe60435 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:43.104384 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4aea2d24-f0f3-4070-a3ec-5842ffe60435 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:43.104998 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4aea2d24-f0f3-4070-a3ec-5842ffe60435 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:43.267268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4aea2d24-f0f3-4070-a3ec-5842ffe60435 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:43.275908 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4aea2d24-f0f3-4070-a3ec-5842ffe60435 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1313 microversion: 2.1 time: 0.187927 Aug 29 19:03:43.281666 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 146/306] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:43 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:43.873743 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5b7db730-43d8-4159-a3d2-00b50909dbc2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:43.874440 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5b7db730-43d8-4159-a3d2-00b50909dbc2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:43.881271 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b7db730-43d8-4159-a3d2-00b50909dbc2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:43.881894 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b7db730-43d8-4159-a3d2-00b50909dbc2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:43.882399 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b7db730-43d8-4159-a3d2-00b50909dbc2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:43.883205 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b7db730-43d8-4159-a3d2-00b50909dbc2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:43.883891 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b7db730-43d8-4159-a3d2-00b50909dbc2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:43.884409 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b7db730-43d8-4159-a3d2-00b50909dbc2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:44.032363 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5b7db730-43d8-4159-a3d2-00b50909dbc2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:44.040477 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5b7db730-43d8-4159-a3d2-00b50909dbc2 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.172212 Aug 29 19:03:44.041169 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 161/307] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:43 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:44.297779 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-53b9843b-8951-460b-b015-cca6f0f36821 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:44.298525 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-53b9843b-8951-460b-b015-cca6f0f36821 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:44.305041 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53b9843b-8951-460b-b015-cca6f0f36821 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:44.305554 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53b9843b-8951-460b-b015-cca6f0f36821 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:44.305989 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53b9843b-8951-460b-b015-cca6f0f36821 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:44.306684 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53b9843b-8951-460b-b015-cca6f0f36821 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:44.307318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53b9843b-8951-460b-b015-cca6f0f36821 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:44.307766 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53b9843b-8951-460b-b015-cca6f0f36821 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:44.312459 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:44.464485 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-53b9843b-8951-460b-b015-cca6f0f36821 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:44.473535 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-53b9843b-8951-460b-b015-cca6f0f36821 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1313 microversion: 2.1 time: 0.180362 Aug 29 19:03:44.474370 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 147/308] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:44 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:45.062661 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-260577c3-903e-4eeb-908d-0e97f8044cfd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:45.063294 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-260577c3-903e-4eeb-908d-0e97f8044cfd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:45.069349 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-260577c3-903e-4eeb-908d-0e97f8044cfd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:45.069829 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-260577c3-903e-4eeb-908d-0e97f8044cfd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:45.070259 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-260577c3-903e-4eeb-908d-0e97f8044cfd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:45.071069 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-260577c3-903e-4eeb-908d-0e97f8044cfd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:45.071524 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-260577c3-903e-4eeb-908d-0e97f8044cfd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:45.071941 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-260577c3-903e-4eeb-908d-0e97f8044cfd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:45.212251 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-260577c3-903e-4eeb-908d-0e97f8044cfd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:45.220239 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-260577c3-903e-4eeb-908d-0e97f8044cfd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.161946 Aug 29 19:03:45.220870 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 162/309] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:45 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:45.494438 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d2b72b4e-5b22-4c20-97e4-98f49d3c9c3b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:45.495491 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d2b72b4e-5b22-4c20-97e4-98f49d3c9c3b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:45.501663 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2b72b4e-5b22-4c20-97e4-98f49d3c9c3b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:45.502066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2b72b4e-5b22-4c20-97e4-98f49d3c9c3b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:45.502506 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2b72b4e-5b22-4c20-97e4-98f49d3c9c3b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:45.503321 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2b72b4e-5b22-4c20-97e4-98f49d3c9c3b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:45.503660 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2b72b4e-5b22-4c20-97e4-98f49d3c9c3b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:45.504080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2b72b4e-5b22-4c20-97e4-98f49d3c9c3b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:45.647046 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d2b72b4e-5b22-4c20-97e4-98f49d3c9c3b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:45.655593 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d2b72b4e-5b22-4c20-97e4-98f49d3c9c3b tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1313 microversion: 2.1 time: 0.164947 Aug 29 19:03:45.656180 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 148/310] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:45 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:46.014366 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a8d2509b-ca9d-4caf-826a-1850296f8dbe tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] Calling method '.version_select at 0x7fb2b9fd31f0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:46.079677 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a8d2509b-ca9d-4caf-826a-1850296f8dbe tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/0682dc34-b0ba-4f94-9137-816944818149" status: 200 len: 350 microversion: 2.1 time: 0.070904 Aug 29 19:03:46.080532 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 163/311] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:03:46 2022] GET /compute/v2.1/os-volumes/0682dc34-b0ba-4f94-9137-816944818149 => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:03:46.242259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a6eb6e9b-6d89-45b8-b375-6c94e85c5ae0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:46.242876 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a6eb6e9b-6d89-45b8-b375-6c94e85c5ae0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:46.249521 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6eb6e9b-6d89-45b8-b375-6c94e85c5ae0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:46.250269 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6eb6e9b-6d89-45b8-b375-6c94e85c5ae0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:46.251033 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6eb6e9b-6d89-45b8-b375-6c94e85c5ae0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:46.252077 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6eb6e9b-6d89-45b8-b375-6c94e85c5ae0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:46.252685 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6eb6e9b-6d89-45b8-b375-6c94e85c5ae0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:46.253254 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6eb6e9b-6d89-45b8-b375-6c94e85c5ae0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:46.429657 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a6eb6e9b-6d89-45b8-b375-6c94e85c5ae0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:46.442583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a6eb6e9b-6d89-45b8-b375-6c94e85c5ae0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.204690 Aug 29 19:03:46.447131 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 149/312] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:46 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:46.696410 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bfb8e02c-9acc-46e6-886d-38f97c9bfdbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:46.697361 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bfb8e02c-9acc-46e6-886d-38f97c9bfdbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:46.705484 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfb8e02c-9acc-46e6-886d-38f97c9bfdbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:46.706104 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfb8e02c-9acc-46e6-886d-38f97c9bfdbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:46.706599 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfb8e02c-9acc-46e6-886d-38f97c9bfdbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:46.707425 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfb8e02c-9acc-46e6-886d-38f97c9bfdbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:46.707941 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfb8e02c-9acc-46e6-886d-38f97c9bfdbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:46.708433 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfb8e02c-9acc-46e6-886d-38f97c9bfdbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:47.019453 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bfb8e02c-9acc-46e6-886d-38f97c9bfdbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:47.027254 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bfb8e02c-9acc-46e6-886d-38f97c9bfdbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1313 microversion: 2.1 time: 0.354708 Aug 29 19:03:47.028007 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 164/313] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:46 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:47.471988 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8c216f27-89e7-4f7c-bca6-7899a311cd6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:47.473360 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8c216f27-89e7-4f7c-bca6-7899a311cd6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:47.477593 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:47.478104 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:47.491577 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c216f27-89e7-4f7c-bca6-7899a311cd6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:47.492381 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c216f27-89e7-4f7c-bca6-7899a311cd6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:47.492984 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c216f27-89e7-4f7c-bca6-7899a311cd6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:47.493852 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c216f27-89e7-4f7c-bca6-7899a311cd6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:47.494460 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c216f27-89e7-4f7c-bca6-7899a311cd6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:47.495061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c216f27-89e7-4f7c-bca6-7899a311cd6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:47.661354 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8c216f27-89e7-4f7c-bca6-7899a311cd6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:47.670977 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8c216f27-89e7-4f7c-bca6-7899a311cd6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.205331 Aug 29 19:03:47.671867 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 150/314] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:47 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:48.049323 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c7238bb6-1fae-46c9-9a92-46c8545e0afa tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:48.049980 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c7238bb6-1fae-46c9-9a92-46c8545e0afa tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:48.052245 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:48.058527 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7238bb6-1fae-46c9-9a92-46c8545e0afa tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:48.059053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7238bb6-1fae-46c9-9a92-46c8545e0afa tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:48.059503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7238bb6-1fae-46c9-9a92-46c8545e0afa tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:48.060924 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7238bb6-1fae-46c9-9a92-46c8545e0afa tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:48.061394 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7238bb6-1fae-46c9-9a92-46c8545e0afa tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:48.061824 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7238bb6-1fae-46c9-9a92-46c8545e0afa tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:48.201477 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c7238bb6-1fae-46c9-9a92-46c8545e0afa tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:48.209005 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c7238bb6-1fae-46c9-9a92-46c8545e0afa tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1313 microversion: 2.1 time: 0.164392 Aug 29 19:03:48.209564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 165/315] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:48 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:48.582233 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-16f75f80-9c73-4f45-8f34-d1f8a24f69c7 tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] Calling method '.version_select at 0x7fb2ba01e550>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:48.636744 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-16f75f80-9c73-4f45-8f34-d1f8a24f69c7 tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/b9c97bb4-5be6-41fe-b346-62bdb4989cc7" status: 200 len: 351 microversion: 2.1 time: 0.065305 Aug 29 19:03:48.637333 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 151/316] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:03:48 2022] GET /compute/v2.1/os-volumes/b9c97bb4-5be6-41fe-b346-62bdb4989cc7 => generated 351 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:03:48.692095 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4065050b-03c8-40c7-a199-5a0f6dc6f4a3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:48.692273 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4065050b-03c8-40c7-a199-5a0f6dc6f4a3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:48.698371 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4065050b-03c8-40c7-a199-5a0f6dc6f4a3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:48.699071 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4065050b-03c8-40c7-a199-5a0f6dc6f4a3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:48.699683 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4065050b-03c8-40c7-a199-5a0f6dc6f4a3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:48.701050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4065050b-03c8-40c7-a199-5a0f6dc6f4a3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:48.701650 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4065050b-03c8-40c7-a199-5a0f6dc6f4a3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:48.702228 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4065050b-03c8-40c7-a199-5a0f6dc6f4a3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:48.852094 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4065050b-03c8-40c7-a199-5a0f6dc6f4a3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:48.861773 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4065050b-03c8-40c7-a199-5a0f6dc6f4a3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.173760 Aug 29 19:03:48.875860 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 166/317] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:48 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:49.229654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-58277a8e-5e7f-4ec7-9fc5-f9db127737d2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:49.230876 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-58277a8e-5e7f-4ec7-9fc5-f9db127737d2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:49.237988 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-58277a8e-5e7f-4ec7-9fc5-f9db127737d2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:49.238774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-58277a8e-5e7f-4ec7-9fc5-f9db127737d2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:49.240019 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-58277a8e-5e7f-4ec7-9fc5-f9db127737d2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:49.240670 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-58277a8e-5e7f-4ec7-9fc5-f9db127737d2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:49.241125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-58277a8e-5e7f-4ec7-9fc5-f9db127737d2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:49.241547 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-58277a8e-5e7f-4ec7-9fc5-f9db127737d2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:49.386881 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-58277a8e-5e7f-4ec7-9fc5-f9db127737d2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:49.394353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-58277a8e-5e7f-4ec7-9fc5-f9db127737d2 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1313 microversion: 2.1 time: 0.168532 Aug 29 19:03:49.394909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 152/318] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:49 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:49.851491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-2aed7da0-e388-48a9-b4af-38aadc1644e0 req-fa7c761a-ee21-447a-9944-0058d5ff62cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5acb2fcc-1d17-4659-b924-2e3e27e17794", "name": "network-vif-plugged", "status": "completed", "tag": "9f8e67cf-33e9-4998-ae61-ac90f0995685"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:03:49.861297 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2aed7da0-e388-48a9-b4af-38aadc1644e0 req-fa7c761a-ee21-447a-9944-0058d5ff62cf service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:49.861807 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2aed7da0-e388-48a9-b4af-38aadc1644e0 req-fa7c761a-ee21-447a-9944-0058d5ff62cf service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:49.862279 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2aed7da0-e388-48a9-b4af-38aadc1644e0 req-fa7c761a-ee21-447a-9944-0058d5ff62cf service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:49.885362 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c6a812d7-f6c6-41c7-b0be-679497b318ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:49.886669 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c6a812d7-f6c6-41c7-b0be-679497b318ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:49.894208 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c6a812d7-f6c6-41c7-b0be-679497b318ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:49.894975 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c6a812d7-f6c6-41c7-b0be-679497b318ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:49.895507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c6a812d7-f6c6-41c7-b0be-679497b318ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:49.896309 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c6a812d7-f6c6-41c7-b0be-679497b318ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:49.896839 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c6a812d7-f6c6-41c7-b0be-679497b318ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:49.897337 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c6a812d7-f6c6-41c7-b0be-679497b318ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:50.018809 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-2aed7da0-e388-48a9-b4af-38aadc1644e0 req-fa7c761a-ee21-447a-9944-0058d5ff62cf service nova] Creating event network-vif-plugged:9f8e67cf-33e9-4998-ae61-ac90f0995685 for instance 5acb2fcc-1d17-4659-b924-2e3e27e17794 on hv-cinder-85083 Aug 29 19:03:50.024002 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-2aed7da0-e388-48a9-b4af-38aadc1644e0 req-fa7c761a-ee21-447a-9944-0058d5ff62cf service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176121 Aug 29 19:03:50.024596 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 167/319] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:03:50.029744 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-01b5e5eb-f245-4c14-a5fa-bb1e0886da4a tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] Calling method '.version_select at 0x7fb2ba14b790>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:50.049683 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c6a812d7-f6c6-41c7-b0be-679497b318ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:50.061133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c6a812d7-f6c6-41c7-b0be-679497b318ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.179720 Aug 29 19:03:50.062807 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 153/320] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:49 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:50.083605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-01b5e5eb-f245-4c14-a5fa-bb1e0886da4a tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/892ccedc-5ad3-4bdd-ac2f-99e89c7a03ba" status: 200 len: 350 microversion: 2.1 time: 0.057724 Aug 29 19:03:50.084165 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 168/321] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:03:50 2022] GET /compute/v2.1/os-volumes/892ccedc-5ad3-4bdd-ac2f-99e89c7a03ba => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:03:50.098543 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-847b47de-5ab8-495a-b635-c83ee19a5300 tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] Calling method '.version_select at 0x7fb2ba172040>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:50.182894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-847b47de-5ab8-495a-b635-c83ee19a5300 tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] 10.222.0.86 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089387 Aug 29 19:03:50.183545 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 154/322] 10.222.0.86 () {58 vars in 1134 bytes} [Mon Aug 29 19:03:50 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:50.197987 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f7b608dd-982f-4afe-aacc-276e98a81e86 tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] Calling method '.version_select at 0x7fb2b9f90e50>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:50.281174 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f7b608dd-982f-4afe-aacc-276e98a81e86 tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] 10.222.0.86 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087049 Aug 29 19:03:50.281727 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 169/323] 10.222.0.86 () {58 vars in 1149 bytes} [Mon Aug 29 19:03:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:03:50.294542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d5ec969a-941e-49c9-922a-74b0437539bd tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] Calling method '.version_select at 0x7fb2bb2b81f0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:50.382167 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d5ec969a-941e-49c9-922a-74b0437539bd tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] 10.222.0.86 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.091356 Aug 29 19:03:50.382854 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 155/324] 10.222.0.86 () {58 vars in 1134 bytes} [Mon Aug 29 19:03:50 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:50.396614 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-97db04b8-b232-4e09-b49d-f117ba36bbf1 tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] Calling method '.version_select at 0x7fb2b9fd53a0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:50.414665 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-adf43e59-cf58-4954-ac28-bbe2f4ad95ef tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:50.415948 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-adf43e59-cf58-4954-ac28-bbe2f4ad95ef tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:50.424363 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-adf43e59-cf58-4954-ac28-bbe2f4ad95ef tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:50.424848 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-adf43e59-cf58-4954-ac28-bbe2f4ad95ef tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:50.425276 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-adf43e59-cf58-4954-ac28-bbe2f4ad95ef tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:50.425967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-adf43e59-cf58-4954-ac28-bbe2f4ad95ef tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:50.426416 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-adf43e59-cf58-4954-ac28-bbe2f4ad95ef tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:50.426831 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-adf43e59-cf58-4954-ac28-bbe2f4ad95ef tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:50.483672 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-97db04b8-b232-4e09-b49d-f117ba36bbf1 tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] 10.222.0.86 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090848 Aug 29 19:03:50.484235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 170/325] 10.222.0.86 () {58 vars in 1167 bytes} [Mon Aug 29 19:03:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:03:50.497122 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-80fc9385-9a81-4c79-88b6-d344bc3770bd tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] Calling method '.version_select at 0x7fb2b9f90940>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:50.578527 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-80fc9385-9a81-4c79-88b6-d344bc3770bd tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084950 Aug 29 19:03:50.579110 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 171/326] 10.222.0.86 () {58 vars in 1170 bytes} [Mon Aug 29 19:03:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:03:50.592558 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-299fc369-3acb-4be7-8ae2-c89d55a393c9 tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] Calling method '.version_select at 0x7fb2b9fd58b0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:50.599797 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-adf43e59-cf58-4954-ac28-bbe2f4ad95ef tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:50.607965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-adf43e59-cf58-4954-ac28-bbe2f4ad95ef tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1313 microversion: 2.1 time: 0.197020 Aug 29 19:03:50.608527 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 156/327] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:50 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:50.671863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-299fc369-3acb-4be7-8ae2-c89d55a393c9 tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.083503 Aug 29 19:03:50.672423 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 172/328] 10.222.0.86 () {58 vars in 1155 bytes} [Mon Aug 29 19:03:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:50.690955 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-35bd14a8-8eb9-4bf1-ad16-f965c94407ad tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] Calling method '.version_select at 0x7fb2ba01eee0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:50.771846 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-35bd14a8-8eb9-4bf1-ad16-f965c94407ad tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085490 Aug 29 19:03:50.772672 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 157/329] 10.222.0.86 () {58 vars in 1188 bytes} [Mon Aug 29 19:03:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:03:50.785866 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-abb7f70c-0c66-43a2-b730-4e7d1dee5af8 tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] Calling method '.version_select at 0x7fb2b9fd5ca0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:50.873610 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-abb7f70c-0c66-43a2-b730-4e7d1dee5af8 tempest-VolumesTestJSON-333937427 tempest-VolumesTestJSON-333937427-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.091417 Aug 29 19:03:50.874222 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 173/330] 10.222.0.86 () {58 vars in 1155 bytes} [Mon Aug 29 19:03:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:51.083932 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2dc48e11-d603-4560-a921-87d6236c7673 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:51.084542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2dc48e11-d603-4560-a921-87d6236c7673 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:51.091227 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dc48e11-d603-4560-a921-87d6236c7673 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:51.091712 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dc48e11-d603-4560-a921-87d6236c7673 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:51.092145 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dc48e11-d603-4560-a921-87d6236c7673 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:51.092827 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dc48e11-d603-4560-a921-87d6236c7673 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:51.093300 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dc48e11-d603-4560-a921-87d6236c7673 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:51.093721 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dc48e11-d603-4560-a921-87d6236c7673 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:51.222983 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2dc48e11-d603-4560-a921-87d6236c7673 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:51.230642 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2dc48e11-d603-4560-a921-87d6236c7673 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1521 microversion: 2.1 time: 0.151066 Aug 29 19:03:51.231217 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 158/331] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:51 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:51.628063 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-440c02dd-2d4b-47bb-b141-d144cd074b90 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:51.628782 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-440c02dd-2d4b-47bb-b141-d144cd074b90 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:51.635461 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-440c02dd-2d4b-47bb-b141-d144cd074b90 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:51.635973 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-440c02dd-2d4b-47bb-b141-d144cd074b90 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:51.636405 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-440c02dd-2d4b-47bb-b141-d144cd074b90 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:51.637093 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-440c02dd-2d4b-47bb-b141-d144cd074b90 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:51.637839 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-440c02dd-2d4b-47bb-b141-d144cd074b90 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:51.637966 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-440c02dd-2d4b-47bb-b141-d144cd074b90 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:51.766863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-440c02dd-2d4b-47bb-b141-d144cd074b90 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:51.774430 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-440c02dd-2d4b-47bb-b141-d144cd074b90 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1313 microversion: 2.1 time: 0.150224 Aug 29 19:03:51.774982 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 174/332] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:51 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:52.251970 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-388a5b51-48ec-474d-b14f-e38994573960 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:52.252507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-388a5b51-48ec-474d-b14f-e38994573960 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:52.258506 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-388a5b51-48ec-474d-b14f-e38994573960 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:52.258981 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-388a5b51-48ec-474d-b14f-e38994573960 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:52.259446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-388a5b51-48ec-474d-b14f-e38994573960 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:52.260134 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-388a5b51-48ec-474d-b14f-e38994573960 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:52.260587 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-388a5b51-48ec-474d-b14f-e38994573960 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:52.261013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-388a5b51-48ec-474d-b14f-e38994573960 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:52.392521 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-388a5b51-48ec-474d-b14f-e38994573960 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:52.401462 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-388a5b51-48ec-474d-b14f-e38994573960 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1501 microversion: 2.1 time: 0.154124 Aug 29 19:03:52.402025 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 159/333] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:52 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:52.421072 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f4f03e8d-cb76-4010-9d78-c529bdbf0be1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:52.421672 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f4f03e8d-cb76-4010-9d78-c529bdbf0be1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:52.428254 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f4f03e8d-cb76-4010-9d78-c529bdbf0be1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:52.428734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f4f03e8d-cb76-4010-9d78-c529bdbf0be1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:52.429165 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f4f03e8d-cb76-4010-9d78-c529bdbf0be1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:52.429842 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f4f03e8d-cb76-4010-9d78-c529bdbf0be1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:52.430286 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f4f03e8d-cb76-4010-9d78-c529bdbf0be1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:52.430698 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f4f03e8d-cb76-4010-9d78-c529bdbf0be1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:52.567283 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f4f03e8d-cb76-4010-9d78-c529bdbf0be1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:52.575348 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f4f03e8d-cb76-4010-9d78-c529bdbf0be1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1516 microversion: 2.1 time: 0.157868 Aug 29 19:03:52.575856 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 175/334] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:52 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:52.796108 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6cc29323-2348-4da2-b4b3-7adaf63ade04 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:52.796899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6cc29323-2348-4da2-b4b3-7adaf63ade04 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:52.803674 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6cc29323-2348-4da2-b4b3-7adaf63ade04 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:52.804157 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6cc29323-2348-4da2-b4b3-7adaf63ade04 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:52.804632 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6cc29323-2348-4da2-b4b3-7adaf63ade04 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:52.805250 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6cc29323-2348-4da2-b4b3-7adaf63ade04 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:52.805696 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6cc29323-2348-4da2-b4b3-7adaf63ade04 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:52.806109 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6cc29323-2348-4da2-b4b3-7adaf63ade04 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:52.954650 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6cc29323-2348-4da2-b4b3-7adaf63ade04 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:52.962636 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6cc29323-2348-4da2-b4b3-7adaf63ade04 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1498 microversion: 2.1 time: 0.171306 Aug 29 19:03:52.963220 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 160/335] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:52 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1498 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:53.966530 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7d8f1a1d-00dc-4f6d-a332-f0dc5aa17e35 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:03:53.969015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7d8f1a1d-00dc-4f6d-a332-f0dc5aa17e35 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:53.974944 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d8f1a1d-00dc-4f6d-a332-f0dc5aa17e35 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:53.975785 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d8f1a1d-00dc-4f6d-a332-f0dc5aa17e35 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:53.976226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d8f1a1d-00dc-4f6d-a332-f0dc5aa17e35 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:53.976920 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d8f1a1d-00dc-4f6d-a332-f0dc5aa17e35 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:53.977374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d8f1a1d-00dc-4f6d-a332-f0dc5aa17e35 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:53.977800 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d8f1a1d-00dc-4f6d-a332-f0dc5aa17e35 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:54.002716 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-7d8f1a1d-00dc-4f6d-a332-f0dc5aa17e35 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lazy-loading 'flavor' on Instance uuid 2e88e76a-d978-4b39-89f0-d1dd5a154250 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:03:54.017609 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:54.082612 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7d8f1a1d-00dc-4f6d-a332-f0dc5aa17e35 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "POST /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250/action" status: 200 len: 32 microversion: 2.1 time: 0.120347 Aug 29 19:03:54.083316 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 176/336] 10.222.0.86 () {60 vars in 1278 bytes} [Mon Aug 29 19:03:53 2022] POST /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250/action => generated 32 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:03:54.092728 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8403d9c9-be71-4c2c-b360-33f5371adcca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:54.093884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8403d9c9-be71-4c2c-b360-33f5371adcca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:54.100173 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8403d9c9-be71-4c2c-b360-33f5371adcca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:54.100673 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8403d9c9-be71-4c2c-b360-33f5371adcca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:54.101366 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8403d9c9-be71-4c2c-b360-33f5371adcca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:54.102104 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8403d9c9-be71-4c2c-b360-33f5371adcca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:54.102503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8403d9c9-be71-4c2c-b360-33f5371adcca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:54.102921 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8403d9c9-be71-4c2c-b360-33f5371adcca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:54.136317 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2167e0b0-4b4d-469f-9d6b-27cf68705cbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:54.137038 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2167e0b0-4b4d-469f-9d6b-27cf68705cbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:54.144818 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2167e0b0-4b4d-469f-9d6b-27cf68705cbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:54.145317 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2167e0b0-4b4d-469f-9d6b-27cf68705cbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:54.145761 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2167e0b0-4b4d-469f-9d6b-27cf68705cbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:54.146463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2167e0b0-4b4d-469f-9d6b-27cf68705cbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:54.146919 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2167e0b0-4b4d-469f-9d6b-27cf68705cbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:54.147375 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2167e0b0-4b4d-469f-9d6b-27cf68705cbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:54.176314 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2167e0b0-4b4d-469f-9d6b-27cf68705cbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:03:54.272998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2167e0b0-4b4d-469f-9d6b-27cf68705cbc tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "DELETE /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 204 len: 0 microversion: 2.1 time: 0.141261 Aug 29 19:03:54.273839 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 177/337] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:03:54 2022] DELETE /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:03:54.282514 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9155c2b4-1e27-4edc-8f77-5712f5ad4a5a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:54.283256 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9155c2b4-1e27-4edc-8f77-5712f5ad4a5a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:54.289618 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9155c2b4-1e27-4edc-8f77-5712f5ad4a5a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:54.290090 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9155c2b4-1e27-4edc-8f77-5712f5ad4a5a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:54.290529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9155c2b4-1e27-4edc-8f77-5712f5ad4a5a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:54.291258 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9155c2b4-1e27-4edc-8f77-5712f5ad4a5a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:54.291716 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9155c2b4-1e27-4edc-8f77-5712f5ad4a5a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:54.292142 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9155c2b4-1e27-4edc-8f77-5712f5ad4a5a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:54.362882 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8403d9c9-be71-4c2c-b360-33f5371adcca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:54.371607 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8403d9c9-be71-4c2c-b360-33f5371adcca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.282640 Aug 29 19:03:54.372897 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 161/338] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:54 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:54.463593 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9155c2b4-1e27-4edc-8f77-5712f5ad4a5a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:54.472906 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9155c2b4-1e27-4edc-8f77-5712f5ad4a5a tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1504 microversion: 2.1 time: 0.194431 Aug 29 19:03:54.473507 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 178/339] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:54 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:55.396323 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-47c2604d-6cd1-4bed-84a3-576faf84e63f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:55.397029 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-47c2604d-6cd1-4bed-84a3-576faf84e63f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:55.404605 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47c2604d-6cd1-4bed-84a3-576faf84e63f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:55.405086 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47c2604d-6cd1-4bed-84a3-576faf84e63f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:55.405685 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47c2604d-6cd1-4bed-84a3-576faf84e63f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:55.406531 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47c2604d-6cd1-4bed-84a3-576faf84e63f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:55.407267 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47c2604d-6cd1-4bed-84a3-576faf84e63f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:55.407688 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47c2604d-6cd1-4bed-84a3-576faf84e63f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:55.495422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6bcd9264-811a-45ed-947e-600b5ae94c12 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:55.496685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6bcd9264-811a-45ed-947e-600b5ae94c12 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:55.505290 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6bcd9264-811a-45ed-947e-600b5ae94c12 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:55.506094 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6bcd9264-811a-45ed-947e-600b5ae94c12 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:55.506747 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6bcd9264-811a-45ed-947e-600b5ae94c12 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:55.507690 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6bcd9264-811a-45ed-947e-600b5ae94c12 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:55.508320 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6bcd9264-811a-45ed-947e-600b5ae94c12 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:55.508917 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6bcd9264-811a-45ed-947e-600b5ae94c12 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:55.690273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-47c2604d-6cd1-4bed-84a3-576faf84e63f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:55.703739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-47c2604d-6cd1-4bed-84a3-576faf84e63f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.312587 Aug 29 19:03:55.704572 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 162/340] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:55 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:55.785229 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6bcd9264-811a-45ed-947e-600b5ae94c12 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:55.794216 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6bcd9264-811a-45ed-947e-600b5ae94c12 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1504 microversion: 2.1 time: 0.303300 Aug 29 19:03:55.795220 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 179/341] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:55 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:56.663413 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-6747a699-6985-4179-82ad-9f539c1afac5 req-65482bd5-39f8-4550-9792-0fcd4cd26c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5acb2fcc-1d17-4659-b924-2e3e27e17794", "name": "network-vif-deleted", "tag": "9f8e67cf-33e9-4998-ae61-ac90f0995685"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:03:56.676021 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-6747a699-6985-4179-82ad-9f539c1afac5 req-65482bd5-39f8-4550-9792-0fcd4cd26c95 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:56.676807 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-6747a699-6985-4179-82ad-9f539c1afac5 req-65482bd5-39f8-4550-9792-0fcd4cd26c95 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:56.677425 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-6747a699-6985-4179-82ad-9f539c1afac5 req-65482bd5-39f8-4550-9792-0fcd4cd26c95 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:56.708218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-6747a699-6985-4179-82ad-9f539c1afac5 req-65482bd5-39f8-4550-9792-0fcd4cd26c95 service nova] Creating event network-vif-deleted:9f8e67cf-33e9-4998-ae61-ac90f0995685 for instance 5acb2fcc-1d17-4659-b924-2e3e27e17794 on hv-cinder-85083 Aug 29 19:03:56.713676 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-6747a699-6985-4179-82ad-9f539c1afac5 req-65482bd5-39f8-4550-9792-0fcd4cd26c95 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054080 Aug 29 19:03:56.714347 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 163/342] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:03:56.744460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-37e50dea-d6fa-49c8-96dd-838e4aa1ebf3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:56.745871 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-37e50dea-d6fa-49c8-96dd-838e4aa1ebf3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:56.753290 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-37e50dea-d6fa-49c8-96dd-838e4aa1ebf3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:56.754216 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-37e50dea-d6fa-49c8-96dd-838e4aa1ebf3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:56.754878 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-37e50dea-d6fa-49c8-96dd-838e4aa1ebf3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:56.755967 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-37e50dea-d6fa-49c8-96dd-838e4aa1ebf3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:56.756611 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-37e50dea-d6fa-49c8-96dd-838e4aa1ebf3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:56.757353 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-37e50dea-d6fa-49c8-96dd-838e4aa1ebf3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:56.816943 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d4b4ccc1-6ec1-4896-a9f4-f8165f56253f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:56.817568 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d4b4ccc1-6ec1-4896-a9f4-f8165f56253f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:56.824430 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4b4ccc1-6ec1-4896-a9f4-f8165f56253f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:56.824924 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4b4ccc1-6ec1-4896-a9f4-f8165f56253f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:56.825353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4b4ccc1-6ec1-4896-a9f4-f8165f56253f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:56.826750 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4b4ccc1-6ec1-4896-a9f4-f8165f56253f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:56.827389 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4b4ccc1-6ec1-4896-a9f4-f8165f56253f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:56.827809 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4b4ccc1-6ec1-4896-a9f4-f8165f56253f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:56.867935 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4b4ccc1-6ec1-4896-a9f4-f8165f56253f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:56.868602 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4b4ccc1-6ec1-4896-a9f4-f8165f56253f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:56.869253 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4b4ccc1-6ec1-4896-a9f4-f8165f56253f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:56.870110 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-d4b4ccc1-6ec1-4896-a9f4-f8165f56253f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lazy-loading 'fault' on Instance uuid 5acb2fcc-1d17-4659-b924-2e3e27e17794 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:03:56.937336 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d4b4ccc1-6ec1-4896-a9f4-f8165f56253f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41227378a57c43219e4ae460c642f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf40ccacdc74575909f541214adf6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:56.957733 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d4b4ccc1-6ec1-4896-a9f4-f8165f56253f tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 200 len: 1303 microversion: 2.1 time: 0.141686 Aug 29 19:03:56.968272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 164/343] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:56 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 1303 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:56.983454 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-37e50dea-d6fa-49c8-96dd-838e4aa1ebf3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:56.992192 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-37e50dea-d6fa-49c8-96dd-838e4aa1ebf3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.251798 Aug 29 19:03:57.005435 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 180/344] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:56 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:03:57.981400 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-81d5235c-68b2-453a-b0ba-c533e2661f19 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:57.982296 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-81d5235c-68b2-453a-b0ba-c533e2661f19 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] [instance: 5acb2fcc-1d17-4659-b924-2e3e27e17794] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:57.990240 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d5235c-68b2-453a-b0ba-c533e2661f19 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:57.990732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d5235c-68b2-453a-b0ba-c533e2661f19 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:57.991453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d5235c-68b2-453a-b0ba-c533e2661f19 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:57.992168 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d5235c-68b2-453a-b0ba-c533e2661f19 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:57.992626 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d5235c-68b2-453a-b0ba-c533e2661f19 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:57.993309 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d5235c-68b2-453a-b0ba-c533e2661f19 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:58.010019 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-81d5235c-68b2-453a-b0ba-c533e2661f19 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] HTTP exception thrown: Instance 5acb2fcc-1d17-4659-b924-2e3e27e17794 could not be found. Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-81d5235c-68b2-453a-b0ba-c533e2661f19 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Request method failure captured: Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 HTTP/1.1 Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ1XhW7u5DVA5ZQs4z1HqeNO7gAPR-qYntRpZ6p-_tzyNHAArRhnpwnlDtBs-baegnVpCcJ3j54YeyzIM0Y15f2bBZojiTIq4LXcsddEtrcSCSQfNwC4JJfxAs6u9t6Z1Mr8qDXh8JB-QRuJO7v1C_y1Nuv63GjQzMnWoTALUO4Y8Ro Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: cbf40ccacdc74575909f541214adf6f7 Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesActionsTest-605021643 Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:03:58.012161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:03:58.014546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/cbf40ccacdc74575909f541214adf6f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/cbf40ccacdc74575909f541214adf6f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/cbf40ccacdc74575909f541214adf6f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_cbf40ccacdc74575909f541214adf6f7"}]}] Aug 29 19:03:58.014546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesActionsTest-605021643 Aug 29 19:03:58.014546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: cbf40ccacdc74575909f541214adf6f7 Aug 29 19:03:58.014546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesActionsTest-605021643 Aug 29 19:03:58.014546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesActionsTest-605021643-project Aug 29 19:03:58.014546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:03:58.014546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:03:58.014546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: 41227378a57c43219e4ae460c642f834 Aug 29 19:03:58.014546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesActionsTest-605021643-project Aug 29 19:03:58.014546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:03:58.014546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance 5acb2fcc-1d17-4659-b924-2e3e27e17794 could not be found. Aug 29 19:03:58.014546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': '5acb2fcc-1d17-4659-b924-2e3e27e17794'} Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5acb2fcc-1d17-4659-b924-2e3e27e17794 could not be found. Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:03:58.015444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5acb2fcc-1d17-4659-b924-2e3e27e17794 could not be found. Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5acb2fcc-1d17-4659-b924-2e3e27e17794 could not be found. Aug 29 19:03:58.016907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:03:58.019045 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-81d5235c-68b2-453a-b0ba-c533e2661f19 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] Returning 404 to user: Instance 5acb2fcc-1d17-4659-b924-2e3e27e17794 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:03:58.019873 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8a865217-9177-4b14-ad73-7d633d634e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:58.020601 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-81d5235c-68b2-453a-b0ba-c533e2661f19 tempest-VolumesActionsTest-605021643 tempest-VolumesActionsTest-605021643-project] 10.222.0.86 "GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794" status: 404 len: 111 microversion: 2.1 time: 0.043405 Aug 29 19:03:58.021308 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 165/345] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:57 2022] GET /compute/v2.1/servers/5acb2fcc-1d17-4659-b924-2e3e27e17794 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:03:58.028485 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8a865217-9177-4b14-ad73-7d633d634e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:58.036270 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a865217-9177-4b14-ad73-7d633d634e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:58.036826 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a865217-9177-4b14-ad73-7d633d634e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:58.037637 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a865217-9177-4b14-ad73-7d633d634e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:58.038509 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a865217-9177-4b14-ad73-7d633d634e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:58.039249 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a865217-9177-4b14-ad73-7d633d634e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:58.039965 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a865217-9177-4b14-ad73-7d633d634e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:58.242090 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8a865217-9177-4b14-ad73-7d633d634e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:58.253900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8a865217-9177-4b14-ad73-7d633d634e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.243956 Aug 29 19:03:58.254455 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 181/346] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:58 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:03:59.275444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0055ddd9-74b2-459c-b26f-a8ab23a367b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:03:59.276141 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0055ddd9-74b2-459c-b26f-a8ab23a367b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:03:59.279181 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:59.284908 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0055ddd9-74b2-459c-b26f-a8ab23a367b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:59.285389 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0055ddd9-74b2-459c-b26f-a8ab23a367b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:59.286012 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0055ddd9-74b2-459c-b26f-a8ab23a367b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:59.286705 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0055ddd9-74b2-459c-b26f-a8ab23a367b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:03:59.287183 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0055ddd9-74b2-459c-b26f-a8ab23a367b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:03:59.287606 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0055ddd9-74b2-459c-b26f-a8ab23a367b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:03:59.422306 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0055ddd9-74b2-459c-b26f-a8ab23a367b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:03:59.430978 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0055ddd9-74b2-459c-b26f-a8ab23a367b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.159261 Aug 29 19:03:59.431602 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 166/347] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:03:59 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:00.452748 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-18ca2fd0-2278-4dd0-a9aa-b135866f8fd1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:00.453385 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-18ca2fd0-2278-4dd0-a9aa-b135866f8fd1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:00.460669 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18ca2fd0-2278-4dd0-a9aa-b135866f8fd1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:00.461210 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18ca2fd0-2278-4dd0-a9aa-b135866f8fd1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:00.461654 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18ca2fd0-2278-4dd0-a9aa-b135866f8fd1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:00.462356 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18ca2fd0-2278-4dd0-a9aa-b135866f8fd1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:00.462815 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18ca2fd0-2278-4dd0-a9aa-b135866f8fd1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:00.463260 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18ca2fd0-2278-4dd0-a9aa-b135866f8fd1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:00.599969 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-18ca2fd0-2278-4dd0-a9aa-b135866f8fd1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:00.608203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-18ca2fd0-2278-4dd0-a9aa-b135866f8fd1 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.159393 Aug 29 19:04:00.608774 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 182/348] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:00 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:04:01.629123 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-dc988904-664b-42f7-89b8-a972490d5511 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:01.629736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-dc988904-664b-42f7-89b8-a972490d5511 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:01.636546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc988904-664b-42f7-89b8-a972490d5511 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:01.637100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc988904-664b-42f7-89b8-a972490d5511 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:01.637666 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc988904-664b-42f7-89b8-a972490d5511 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:01.638427 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc988904-664b-42f7-89b8-a972490d5511 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:01.638955 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc988904-664b-42f7-89b8-a972490d5511 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:01.639418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc988904-664b-42f7-89b8-a972490d5511 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:01.786842 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-dc988904-664b-42f7-89b8-a972490d5511 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:01.795257 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-dc988904-664b-42f7-89b8-a972490d5511 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.169371 Aug 29 19:04:01.795838 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 167/349] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:01 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:02.816934 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9e1aecd7-6f54-4320-909c-7992d7b5a418 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:02.817536 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9e1aecd7-6f54-4320-909c-7992d7b5a418 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:02.823898 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e1aecd7-6f54-4320-909c-7992d7b5a418 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:02.824443 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e1aecd7-6f54-4320-909c-7992d7b5a418 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:02.824935 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e1aecd7-6f54-4320-909c-7992d7b5a418 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:02.825695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e1aecd7-6f54-4320-909c-7992d7b5a418 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:02.826210 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e1aecd7-6f54-4320-909c-7992d7b5a418 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:02.826719 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e1aecd7-6f54-4320-909c-7992d7b5a418 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:02.981489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9e1aecd7-6f54-4320-909c-7992d7b5a418 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:02.991572 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9e1aecd7-6f54-4320-909c-7992d7b5a418 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.179121 Aug 29 19:04:02.992263 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 183/350] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:02 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:04.012093 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5cf05b13-f8d2-4b2e-b65f-c9230f016801 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:04.012691 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5cf05b13-f8d2-4b2e-b65f-c9230f016801 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:04.019664 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5cf05b13-f8d2-4b2e-b65f-c9230f016801 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:04.020142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5cf05b13-f8d2-4b2e-b65f-c9230f016801 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:04.020568 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5cf05b13-f8d2-4b2e-b65f-c9230f016801 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:04.021242 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5cf05b13-f8d2-4b2e-b65f-c9230f016801 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:04.021691 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5cf05b13-f8d2-4b2e-b65f-c9230f016801 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:04.022105 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5cf05b13-f8d2-4b2e-b65f-c9230f016801 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:04.152910 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5cf05b13-f8d2-4b2e-b65f-c9230f016801 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:04.156365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:04.161492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5cf05b13-f8d2-4b2e-b65f-c9230f016801 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.153178 Aug 29 19:04:04.162050 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 168/351] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:04 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:05.182181 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-31911fb9-d802-4a54-bb8e-f7cc4c5e9e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:05.182788 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-31911fb9-d802-4a54-bb8e-f7cc4c5e9e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:05.189308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31911fb9-d802-4a54-bb8e-f7cc4c5e9e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:05.189783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31911fb9-d802-4a54-bb8e-f7cc4c5e9e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:05.190210 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31911fb9-d802-4a54-bb8e-f7cc4c5e9e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:05.190884 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31911fb9-d802-4a54-bb8e-f7cc4c5e9e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:05.191351 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31911fb9-d802-4a54-bb8e-f7cc4c5e9e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:05.191766 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31911fb9-d802-4a54-bb8e-f7cc4c5e9e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:05.336608 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-31911fb9-d802-4a54-bb8e-f7cc4c5e9e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:05.346269 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-31911fb9-d802-4a54-bb8e-f7cc4c5e9e25 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.167876 Aug 29 19:04:05.346948 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 184/352] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:05 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:06.369283 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-063d94bc-18bf-4e10-92bb-f8f6b42c5843 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:06.370163 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-063d94bc-18bf-4e10-92bb-f8f6b42c5843 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:06.379692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-063d94bc-18bf-4e10-92bb-f8f6b42c5843 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:06.380488 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-063d94bc-18bf-4e10-92bb-f8f6b42c5843 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:06.381113 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-063d94bc-18bf-4e10-92bb-f8f6b42c5843 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:06.382082 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-063d94bc-18bf-4e10-92bb-f8f6b42c5843 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:06.382753 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-063d94bc-18bf-4e10-92bb-f8f6b42c5843 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:06.383403 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-063d94bc-18bf-4e10-92bb-f8f6b42c5843 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:06.588755 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-063d94bc-18bf-4e10-92bb-f8f6b42c5843 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:06.598578 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-063d94bc-18bf-4e10-92bb-f8f6b42c5843 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.233968 Aug 29 19:04:06.614036 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 169/353] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:06 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:07.621273 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4e62d995-8138-46f2-95f1-0ea324a5ea8e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:07.621885 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4e62d995-8138-46f2-95f1-0ea324a5ea8e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:07.629094 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e62d995-8138-46f2-95f1-0ea324a5ea8e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:07.629586 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e62d995-8138-46f2-95f1-0ea324a5ea8e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:07.630024 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e62d995-8138-46f2-95f1-0ea324a5ea8e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:07.630723 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e62d995-8138-46f2-95f1-0ea324a5ea8e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:07.631227 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e62d995-8138-46f2-95f1-0ea324a5ea8e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:07.633153 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e62d995-8138-46f2-95f1-0ea324a5ea8e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:07.815014 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4e62d995-8138-46f2-95f1-0ea324a5ea8e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:07.823331 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4e62d995-8138-46f2-95f1-0ea324a5ea8e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.206018 Aug 29 19:04:07.845291 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 185/354] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:07 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:04:08.845746 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c0c4b6be-bbe4-45bc-859c-c04293cc746a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:08.846377 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c0c4b6be-bbe4-45bc-859c-c04293cc746a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:08.853021 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0c4b6be-bbe4-45bc-859c-c04293cc746a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:08.853498 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0c4b6be-bbe4-45bc-859c-c04293cc746a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:08.853950 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0c4b6be-bbe4-45bc-859c-c04293cc746a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:08.854632 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0c4b6be-bbe4-45bc-859c-c04293cc746a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:08.855102 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0c4b6be-bbe4-45bc-859c-c04293cc746a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:08.855522 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0c4b6be-bbe4-45bc-859c-c04293cc746a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:09.002501 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c0c4b6be-bbe4-45bc-859c-c04293cc746a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:09.014048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c0c4b6be-bbe4-45bc-859c-c04293cc746a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.171853 Aug 29 19:04:09.014641 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 170/355] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:08 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:09.813599 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-805870156", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:04:09.834404 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:09.888926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] validate_networks() for None {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:04:10.042004 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-af0da322-50a4-49db-a447-f4d22e25ab61 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:10.042823 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-af0da322-50a4-49db-a447-f4d22e25ab61 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:10.052224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af0da322-50a4-49db-a447-f4d22e25ab61 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:10.053036 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af0da322-50a4-49db-a447-f4d22e25ab61 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:10.053682 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af0da322-50a4-49db-a447-f4d22e25ab61 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:10.054587 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af0da322-50a4-49db-a447-f4d22e25ab61 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:10.055268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af0da322-50a4-49db-a447-f4d22e25ab61 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:10.055696 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af0da322-50a4-49db-a447-f4d22e25ab61 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:10.620795 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:04:10.621214 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:04:10.621699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:04:10.622141 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:04:10.623160 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:04:10.637231 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-af0da322-50a4-49db-a447-f4d22e25ab61 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:10.647289 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:10.647798 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:10.648270 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:10.649030 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:10.649499 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:10.649928 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:10.651157 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-af0da322-50a4-49db-a447-f4d22e25ab61 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.612572 Aug 29 19:04:10.671672 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 171/356] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:10 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:10.694167 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Getting quotas for project 350221a9b0c14c70b92f48cae0d3a838. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:04:10.701666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Getting quotas for user d0f11e586dc64a41a84248b4a4c894a9 and project 350221a9b0c14c70b92f48cae0d3a838. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:04:10.741920 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:04:10.744294 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:04:10.805430 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b074638d-7c3c-4be2-ab0b-0bfe8755cf74 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.001455 Aug 29 19:04:10.806081 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 186/357] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:04:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:04:10.831966 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d315ddb8-7189-4f14-94bb-ae4afbe84234 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:10.838071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d315ddb8-7189-4f14-94bb-ae4afbe84234 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:10.913137 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d315ddb8-7189-4f14-94bb-ae4afbe84234 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:10.929099 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d315ddb8-7189-4f14-94bb-ae4afbe84234 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1214 microversion: 2.1 time: 0.112821 Aug 29 19:04:10.929099 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 172/358] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:10 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:11.732543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9d9e7a4e-1e46-4ad7-98eb-7265acf8f8d5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:11.732543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9d9e7a4e-1e46-4ad7-98eb-7265acf8f8d5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:11.732543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9d9e7a4e-1e46-4ad7-98eb-7265acf8f8d5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:11.732543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9d9e7a4e-1e46-4ad7-98eb-7265acf8f8d5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:11.733173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9d9e7a4e-1e46-4ad7-98eb-7265acf8f8d5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:11.733173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9d9e7a4e-1e46-4ad7-98eb-7265acf8f8d5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:11.733173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9d9e7a4e-1e46-4ad7-98eb-7265acf8f8d5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:11.733173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9d9e7a4e-1e46-4ad7-98eb-7265acf8f8d5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:11.969024 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-914f1e95-38a6-456d-9e2b-87799edb3ae2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:11.970383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-914f1e95-38a6-456d-9e2b-87799edb3ae2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:11.977587 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-914f1e95-38a6-456d-9e2b-87799edb3ae2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:11.978412 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-914f1e95-38a6-456d-9e2b-87799edb3ae2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:11.979202 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-914f1e95-38a6-456d-9e2b-87799edb3ae2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:11.980196 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-914f1e95-38a6-456d-9e2b-87799edb3ae2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:11.980853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-914f1e95-38a6-456d-9e2b-87799edb3ae2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:11.981390 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-914f1e95-38a6-456d-9e2b-87799edb3ae2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:12.065880 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9d9e7a4e-1e46-4ad7-98eb-7265acf8f8d5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:12.076233 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9d9e7a4e-1e46-4ad7-98eb-7265acf8f8d5 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.388208 Aug 29 19:04:12.077355 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 187/359] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:11 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:12.097161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-914f1e95-38a6-456d-9e2b-87799edb3ae2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:12.111516 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-914f1e95-38a6-456d-9e2b-87799edb3ae2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1266 microversion: 2.1 time: 0.163345 Aug 29 19:04:12.131190 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 173/360] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:11 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:04:13.101405 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0a3445e0-2fd0-4c16-9719-3e9e1765bc97 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:13.102179 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0a3445e0-2fd0-4c16-9719-3e9e1765bc97 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:13.122888 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a3445e0-2fd0-4c16-9719-3e9e1765bc97 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:13.123391 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a3445e0-2fd0-4c16-9719-3e9e1765bc97 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:13.125855 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a3445e0-2fd0-4c16-9719-3e9e1765bc97 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:13.126588 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a3445e0-2fd0-4c16-9719-3e9e1765bc97 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:13.132274 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bf5214ba-1950-4e48-8511-15731cc2b77d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:13.133469 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bf5214ba-1950-4e48-8511-15731cc2b77d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:13.137352 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a3445e0-2fd0-4c16-9719-3e9e1765bc97 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:13.140182 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a3445e0-2fd0-4c16-9719-3e9e1765bc97 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:13.142439 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bf5214ba-1950-4e48-8511-15731cc2b77d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:13.143139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bf5214ba-1950-4e48-8511-15731cc2b77d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:13.144881 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bf5214ba-1950-4e48-8511-15731cc2b77d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:13.144881 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bf5214ba-1950-4e48-8511-15731cc2b77d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:13.145328 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bf5214ba-1950-4e48-8511-15731cc2b77d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:13.145938 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bf5214ba-1950-4e48-8511-15731cc2b77d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:13.280027 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bf5214ba-1950-4e48-8511-15731cc2b77d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:13.293337 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bf5214ba-1950-4e48-8511-15731cc2b77d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1266 microversion: 2.1 time: 0.163751 Aug 29 19:04:13.294982 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 174/361] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:13 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:04:13.395187 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0a3445e0-2fd0-4c16-9719-3e9e1765bc97 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:13.406023 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0a3445e0-2fd0-4c16-9719-3e9e1765bc97 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.308447 Aug 29 19:04:13.407007 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 188/362] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:13 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:04:14.318525 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-96d4b5d0-82f7-4958-bb22-05b2f70001ce tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:14.321295 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-96d4b5d0-82f7-4958-bb22-05b2f70001ce tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:14.332492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-96d4b5d0-82f7-4958-bb22-05b2f70001ce tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:14.333251 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-96d4b5d0-82f7-4958-bb22-05b2f70001ce tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:14.333903 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-96d4b5d0-82f7-4958-bb22-05b2f70001ce tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:14.334755 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-96d4b5d0-82f7-4958-bb22-05b2f70001ce tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:14.335427 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-96d4b5d0-82f7-4958-bb22-05b2f70001ce tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:14.336043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-96d4b5d0-82f7-4958-bb22-05b2f70001ce tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:14.437166 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-54e62633-68b9-4055-9b58-362f21b130df tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:14.437836 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-54e62633-68b9-4055-9b58-362f21b130df tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:14.439786 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-96d4b5d0-82f7-4958-bb22-05b2f70001ce tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:14.446769 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54e62633-68b9-4055-9b58-362f21b130df tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:14.447283 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54e62633-68b9-4055-9b58-362f21b130df tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:14.447719 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54e62633-68b9-4055-9b58-362f21b130df tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:14.448410 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54e62633-68b9-4055-9b58-362f21b130df tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:14.448862 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54e62633-68b9-4055-9b58-362f21b130df tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:14.449344 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54e62633-68b9-4055-9b58-362f21b130df tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:14.452215 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-96d4b5d0-82f7-4958-bb22-05b2f70001ce tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1266 microversion: 2.1 time: 0.139122 Aug 29 19:04:14.453752 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 175/363] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:14 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:04:14.627194 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-54e62633-68b9-4055-9b58-362f21b130df tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:14.637658 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-54e62633-68b9-4055-9b58-362f21b130df tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.203247 Aug 29 19:04:14.637658 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 189/364] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:14 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:15.475901 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6872eede-df96-4c1b-978b-b5f42b915f7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:15.476893 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6872eede-df96-4c1b-978b-b5f42b915f7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:15.486343 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6872eede-df96-4c1b-978b-b5f42b915f7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:15.486834 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6872eede-df96-4c1b-978b-b5f42b915f7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:15.487298 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6872eede-df96-4c1b-978b-b5f42b915f7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:15.487996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6872eede-df96-4c1b-978b-b5f42b915f7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:15.499803 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6872eede-df96-4c1b-978b-b5f42b915f7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:15.500883 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6872eede-df96-4c1b-978b-b5f42b915f7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:15.589205 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6872eede-df96-4c1b-978b-b5f42b915f7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:15.602494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6872eede-df96-4c1b-978b-b5f42b915f7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1284 microversion: 2.1 time: 0.133097 Aug 29 19:04:15.603274 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 176/365] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:15 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:15.658539 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dae65422-f74a-482d-ac67-4b0bdcd315ab tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:15.659894 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dae65422-f74a-482d-ac67-4b0bdcd315ab tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:15.667367 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dae65422-f74a-482d-ac67-4b0bdcd315ab tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:15.668153 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dae65422-f74a-482d-ac67-4b0bdcd315ab tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:15.668807 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dae65422-f74a-482d-ac67-4b0bdcd315ab tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:15.670476 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dae65422-f74a-482d-ac67-4b0bdcd315ab tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:15.671181 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dae65422-f74a-482d-ac67-4b0bdcd315ab tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:15.671630 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dae65422-f74a-482d-ac67-4b0bdcd315ab tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:15.892318 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dae65422-f74a-482d-ac67-4b0bdcd315ab tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:15.899963 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:15.906250 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dae65422-f74a-482d-ac67-4b0bdcd315ab tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.250754 Aug 29 19:04:15.907408 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 190/366] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:15 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:16.624762 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b3d5ff92-7852-41ce-8218-7260cef99ff0 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:16.626098 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b3d5ff92-7852-41ce-8218-7260cef99ff0 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:16.636819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b3d5ff92-7852-41ce-8218-7260cef99ff0 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:16.637352 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b3d5ff92-7852-41ce-8218-7260cef99ff0 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:16.638292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b3d5ff92-7852-41ce-8218-7260cef99ff0 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:16.639152 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b3d5ff92-7852-41ce-8218-7260cef99ff0 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:16.639484 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b3d5ff92-7852-41ce-8218-7260cef99ff0 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:16.639916 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b3d5ff92-7852-41ce-8218-7260cef99ff0 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:16.740879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b3d5ff92-7852-41ce-8218-7260cef99ff0 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:16.749803 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b3d5ff92-7852-41ce-8218-7260cef99ff0 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1272 microversion: 2.1 time: 0.129537 Aug 29 19:04:16.765442 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 177/367] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:16 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1272 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:04:16.933647 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f93b85af-642d-4900-b6a7-7f3b271b7834 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:16.934261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f93b85af-642d-4900-b6a7-7f3b271b7834 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:16.948768 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f93b85af-642d-4900-b6a7-7f3b271b7834 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:16.949539 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f93b85af-642d-4900-b6a7-7f3b271b7834 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:16.950153 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f93b85af-642d-4900-b6a7-7f3b271b7834 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:16.951054 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f93b85af-642d-4900-b6a7-7f3b271b7834 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:16.951658 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f93b85af-642d-4900-b6a7-7f3b271b7834 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:16.953208 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f93b85af-642d-4900-b6a7-7f3b271b7834 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:17.212864 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f93b85af-642d-4900-b6a7-7f3b271b7834 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:17.226516 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f93b85af-642d-4900-b6a7-7f3b271b7834 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1502 microversion: 2.1 time: 0.296357 Aug 29 19:04:17.232760 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 191/368] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:16 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1502 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:17.254850 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6a2fde14-6c6e-49b3-98eb-abf81451a9b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b2f8841-8c47-445f-8f2a-269c10950d1f"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:04:17.258123 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6a2fde14-6c6e-49b3-98eb-abf81451a9b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:17.264954 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a2fde14-6c6e-49b3-98eb-abf81451a9b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:17.266188 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a2fde14-6c6e-49b3-98eb-abf81451a9b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:17.267374 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a2fde14-6c6e-49b3-98eb-abf81451a9b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:17.269035 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a2fde14-6c6e-49b3-98eb-abf81451a9b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:17.269772 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a2fde14-6c6e-49b3-98eb-abf81451a9b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:17.270421 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a2fde14-6c6e-49b3-98eb-abf81451a9b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:17.300599 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-6a2fde14-6c6e-49b3-98eb-abf81451a9b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] HTTP exception thrown: Cannot 'attach_volume' instance 2e88e76a-d978-4b39-89f0-d1dd5a154250 while it is in vm_state rescued Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6a2fde14-6c6e-49b3-98eb-abf81451a9b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Request method failure captured: Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: POST /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250/os-volume_attachments HTTP/1.1 Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 74 Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0iXUiYAovRqQ_az3rcpV1ErfEOG6trSM7yEPHZtNh_PNMrhUUN1DHoJV2O5dMcZRrxSKLkM3xKL5tZa-zkwcA48hyuHNQtm_bZy3itxXiOiqM8IYzpwkftFeh9qTl5oUhccTMyqLAPh4AYeWpt5neoT-NEmjsyd5fGZ_d_CGMaZrA Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 4f32b60f5fa8427386bafa1a91f4e608 Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-582562329 Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:04:17.303335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:04:17.304942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4f32b60f5fa8427386bafa1a91f4e608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4f32b60f5fa8427386bafa1a91f4e608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/4f32b60f5fa8427386bafa1a91f4e608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_4f32b60f5fa8427386bafa1a91f4e608"}]}] Aug 29 19:04:17.304942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-ServerRescueNegativeTestJSON-582562329 Aug 29 19:04:17.304942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 4f32b60f5fa8427386bafa1a91f4e608 Aug 29 19:04:17.304942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-582562329 Aug 29 19:04:17.304942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-ServerRescueNegativeTestJSON-582562329-project Aug 29 19:04:17.304942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:04:17.304942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:04:17.304942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: 962284e9a353430881bc119e5f80a890 Aug 29 19:04:17.304942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-ServerRescueNegativeTestJSON-582562329-project Aug 29 19:04:17.304942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Aug 29 19:04:17.304942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {"volumeAttachment": {"volumeId": "7b2f8841-8c47-445f-8f2a-269c10950d1f"}} Aug 29 19:04:17.304942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Cannot 'attach_volume' instance 2e88e76a-d978-4b39-89f0-d1dd5a154250 while it is in vm_state rescued Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'server_id': '2e88e76a-d978-4b39-89f0-d1dd5a154250', 'body': {'volumeAttachment': {'volumeId': '7b2f8841-8c47-445f-8f2a-269c10950d1f'}}} Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2e88e76a-d978-4b39-89f0-d1dd5a154250 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:04:17.305853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2e88e76a-d978-4b39-89f0-d1dd5a154250 while it is in vm_state rescued Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:04:17.309279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:04:17.313040 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:04:17.313040 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:04:17.313040 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2e88e76a-d978-4b39-89f0-d1dd5a154250 while it is in vm_state rescued Aug 29 19:04:17.313040 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:04:17.314413 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6a2fde14-6c6e-49b3-98eb-abf81451a9b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Returning 409 to user: Cannot 'attach_volume' instance 2e88e76a-d978-4b39-89f0-d1dd5a154250 while it is in vm_state rescued {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:04:17.315576 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6a2fde14-6c6e-49b3-98eb-abf81451a9b0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "POST /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.065383 Aug 29 19:04:17.316376 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 178/369] 10.222.0.86 () {60 vars in 1323 bytes} [Mon Aug 29 19:04:17 2022] POST /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250/os-volume_attachments => generated 152 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 19:04:17.326629 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7501eccf-63a0-4d5f-89c6-86fcc5b83bac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:04:17.327205 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7501eccf-63a0-4d5f-89c6-86fcc5b83bac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:17.343465 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7501eccf-63a0-4d5f-89c6-86fcc5b83bac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:17.343949 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7501eccf-63a0-4d5f-89c6-86fcc5b83bac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:17.344673 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7501eccf-63a0-4d5f-89c6-86fcc5b83bac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:17.345549 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7501eccf-63a0-4d5f-89c6-86fcc5b83bac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:17.346150 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7501eccf-63a0-4d5f-89c6-86fcc5b83bac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:17.346724 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7501eccf-63a0-4d5f-89c6-86fcc5b83bac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:17.439095 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7501eccf-63a0-4d5f-89c6-86fcc5b83bac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "POST /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250/action" status: 202 len: 0 microversion: 2.1 time: 0.112085 Aug 29 19:04:17.439853 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 192/370] 10.222.0.86 () {60 vars in 1278 bytes} [Mon Aug 29 19:04:17 2022] POST /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:04:17.448512 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7735e97a-db79-45e6-83c7-837babfd5524 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:17.449557 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7735e97a-db79-45e6-83c7-837babfd5524 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:17.464030 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7735e97a-db79-45e6-83c7-837babfd5524 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:17.464864 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7735e97a-db79-45e6-83c7-837babfd5524 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:17.465568 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7735e97a-db79-45e6-83c7-837babfd5524 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:17.467081 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7735e97a-db79-45e6-83c7-837babfd5524 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:17.467760 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7735e97a-db79-45e6-83c7-837babfd5524 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:17.468376 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7735e97a-db79-45e6-83c7-837babfd5524 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:17.694863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7735e97a-db79-45e6-83c7-837babfd5524 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:17.714124 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7735e97a-db79-45e6-83c7-837babfd5524 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1510 microversion: 2.1 time: 0.268710 Aug 29 19:04:17.715084 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 179/371] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:17 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:17.775232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1c477cf7-e091-4518-93e3-09395ea5006f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:17.775940 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1c477cf7-e091-4518-93e3-09395ea5006f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:17.785853 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1c477cf7-e091-4518-93e3-09395ea5006f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:17.786351 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1c477cf7-e091-4518-93e3-09395ea5006f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:17.786789 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1c477cf7-e091-4518-93e3-09395ea5006f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:17.787526 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1c477cf7-e091-4518-93e3-09395ea5006f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:17.791452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1c477cf7-e091-4518-93e3-09395ea5006f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:17.792153 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1c477cf7-e091-4518-93e3-09395ea5006f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:18.078090 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-2ece3c01-36cf-458c-8d27-17edeb588975 req-5e3d7b8b-f57f-4fe1-8ba3-a80223758e58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a", "tag": "84f5da8e-f9f0-4484-aaeb-d86ac78c367b"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:04:18.103950 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-2ece3c01-36cf-458c-8d27-17edeb588975 req-5e3d7b8b-f57f-4fe1-8ba3-a80223758e58 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:18.104774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-2ece3c01-36cf-458c-8d27-17edeb588975 req-5e3d7b8b-f57f-4fe1-8ba3-a80223758e58 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:18.105959 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-2ece3c01-36cf-458c-8d27-17edeb588975 req-5e3d7b8b-f57f-4fe1-8ba3-a80223758e58 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:18.144324 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-2ece3c01-36cf-458c-8d27-17edeb588975 req-5e3d7b8b-f57f-4fe1-8ba3-a80223758e58 service nova] Creating event network-changed:84f5da8e-f9f0-4484-aaeb-d86ac78c367b for instance 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a on hv-cinder-85083 Aug 29 19:04:18.152457 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-2ece3c01-36cf-458c-8d27-17edeb588975 req-5e3d7b8b-f57f-4fe1-8ba3-a80223758e58 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081061 Aug 29 19:04:18.154185 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 180/372] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:04:18.252595 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1c477cf7-e091-4518-93e3-09395ea5006f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:18.263028 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1c477cf7-e091-4518-93e3-09395ea5006f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.492051 Aug 29 19:04:18.280749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 193/373] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:17 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:18.757245 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-80d62846-721a-4048-96cf-4ccbdc47a9fb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:18.770505 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-80d62846-721a-4048-96cf-4ccbdc47a9fb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:18.777788 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80d62846-721a-4048-96cf-4ccbdc47a9fb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:18.778975 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80d62846-721a-4048-96cf-4ccbdc47a9fb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:18.779659 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80d62846-721a-4048-96cf-4ccbdc47a9fb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:18.780628 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80d62846-721a-4048-96cf-4ccbdc47a9fb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:18.781479 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80d62846-721a-4048-96cf-4ccbdc47a9fb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:18.782131 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80d62846-721a-4048-96cf-4ccbdc47a9fb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:19.008937 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-80d62846-721a-4048-96cf-4ccbdc47a9fb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:19.017700 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-80d62846-721a-4048-96cf-4ccbdc47a9fb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1510 microversion: 2.1 time: 0.281956 Aug 29 19:04:19.019692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 181/374] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:18 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:04:19.284783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5e0367aa-365b-4284-b2c2-dedb052c162c tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:19.285432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5e0367aa-365b-4284-b2c2-dedb052c162c tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:19.291372 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e0367aa-365b-4284-b2c2-dedb052c162c tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:19.291854 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e0367aa-365b-4284-b2c2-dedb052c162c tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:19.292284 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e0367aa-365b-4284-b2c2-dedb052c162c tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:19.293036 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e0367aa-365b-4284-b2c2-dedb052c162c tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:19.293487 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e0367aa-365b-4284-b2c2-dedb052c162c tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:19.293908 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e0367aa-365b-4284-b2c2-dedb052c162c tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:19.451220 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5e0367aa-365b-4284-b2c2-dedb052c162c tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:19.459945 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5e0367aa-365b-4284-b2c2-dedb052c162c tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.178982 Aug 29 19:04:19.474681 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 194/375] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:19 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:20.040209 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-795efee8-8236-41e8-9257-bbb164ce5ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:20.041574 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-795efee8-8236-41e8-9257-bbb164ce5ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:20.049790 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-795efee8-8236-41e8-9257-bbb164ce5ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:20.050526 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-795efee8-8236-41e8-9257-bbb164ce5ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:20.051189 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-795efee8-8236-41e8-9257-bbb164ce5ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:20.052081 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-795efee8-8236-41e8-9257-bbb164ce5ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:20.052526 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-795efee8-8236-41e8-9257-bbb164ce5ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:20.052944 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-795efee8-8236-41e8-9257-bbb164ce5ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:20.196910 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-795efee8-8236-41e8-9257-bbb164ce5ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:20.205739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-795efee8-8236-41e8-9257-bbb164ce5ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1510 microversion: 2.1 time: 0.169274 Aug 29 19:04:20.206402 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 182/376] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:20 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:20.485029 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5b7048dd-2628-4599-b79a-360e71c8e781 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:20.486623 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5b7048dd-2628-4599-b79a-360e71c8e781 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:20.494808 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b7048dd-2628-4599-b79a-360e71c8e781 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:20.495816 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b7048dd-2628-4599-b79a-360e71c8e781 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:20.496585 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b7048dd-2628-4599-b79a-360e71c8e781 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:20.498101 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b7048dd-2628-4599-b79a-360e71c8e781 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:20.499139 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b7048dd-2628-4599-b79a-360e71c8e781 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:20.499862 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b7048dd-2628-4599-b79a-360e71c8e781 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:20.671673 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:20.678074 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5b7048dd-2628-4599-b79a-360e71c8e781 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:20.687136 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5b7048dd-2628-4599-b79a-360e71c8e781 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.208989 Aug 29 19:04:20.687985 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 195/377] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:20 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:21.226768 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f62da410-8b20-48fd-8903-1b0005414e93 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:21.227802 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f62da410-8b20-48fd-8903-1b0005414e93 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:21.234792 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:21.238081 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f62da410-8b20-48fd-8903-1b0005414e93 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:21.238887 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f62da410-8b20-48fd-8903-1b0005414e93 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:21.239780 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f62da410-8b20-48fd-8903-1b0005414e93 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:21.241283 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f62da410-8b20-48fd-8903-1b0005414e93 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:21.242210 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f62da410-8b20-48fd-8903-1b0005414e93 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:21.243179 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f62da410-8b20-48fd-8903-1b0005414e93 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:21.436277 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f62da410-8b20-48fd-8903-1b0005414e93 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:21.446296 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f62da410-8b20-48fd-8903-1b0005414e93 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1510 microversion: 2.1 time: 0.223493 Aug 29 19:04:21.446928 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 183/378] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:21 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:21.713278 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f76d6bde-7222-4656-9865-2e528e30bbf1 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:21.713926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f76d6bde-7222-4656-9865-2e528e30bbf1 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:21.720128 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=6 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:21.721961 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f76d6bde-7222-4656-9865-2e528e30bbf1 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:21.722863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f76d6bde-7222-4656-9865-2e528e30bbf1 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:21.723474 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f76d6bde-7222-4656-9865-2e528e30bbf1 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:21.724537 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f76d6bde-7222-4656-9865-2e528e30bbf1 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:21.725133 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f76d6bde-7222-4656-9865-2e528e30bbf1 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:21.725689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f76d6bde-7222-4656-9865-2e528e30bbf1 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:21.893389 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f76d6bde-7222-4656-9865-2e528e30bbf1 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:21.901137 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f76d6bde-7222-4656-9865-2e528e30bbf1 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.193034 Aug 29 19:04:21.901695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 196/379] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:21 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:22.468245 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a44dd083-8cdf-408b-adb8-8e8a0f95dc53 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:22.468849 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a44dd083-8cdf-408b-adb8-8e8a0f95dc53 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:22.475653 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a44dd083-8cdf-408b-adb8-8e8a0f95dc53 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:22.476144 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a44dd083-8cdf-408b-adb8-8e8a0f95dc53 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:22.476577 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a44dd083-8cdf-408b-adb8-8e8a0f95dc53 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:22.477283 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a44dd083-8cdf-408b-adb8-8e8a0f95dc53 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:22.477729 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a44dd083-8cdf-408b-adb8-8e8a0f95dc53 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:22.478148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a44dd083-8cdf-408b-adb8-8e8a0f95dc53 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:22.617452 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a44dd083-8cdf-408b-adb8-8e8a0f95dc53 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:22.625796 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a44dd083-8cdf-408b-adb8-8e8a0f95dc53 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1510 microversion: 2.1 time: 0.161363 Aug 29 19:04:22.626362 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 184/380] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:22 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:22.924856 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-997bd7cf-05da-4977-8623-479b4b8ced6d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:22.925484 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-997bd7cf-05da-4977-8623-479b4b8ced6d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:22.931354 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-997bd7cf-05da-4977-8623-479b4b8ced6d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:22.931854 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-997bd7cf-05da-4977-8623-479b4b8ced6d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:22.932285 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-997bd7cf-05da-4977-8623-479b4b8ced6d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:22.932965 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-997bd7cf-05da-4977-8623-479b4b8ced6d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:22.933421 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-997bd7cf-05da-4977-8623-479b4b8ced6d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:22.933836 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-997bd7cf-05da-4977-8623-479b4b8ced6d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:23.061675 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-997bd7cf-05da-4977-8623-479b4b8ced6d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:23.069585 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-997bd7cf-05da-4977-8623-479b4b8ced6d tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.148700 Aug 29 19:04:23.070137 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 197/381] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:22 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:23.649085 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-00b32b67-9bc1-4a68-97ea-552871d55d6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:23.649653 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-00b32b67-9bc1-4a68-97ea-552871d55d6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:23.656575 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-00b32b67-9bc1-4a68-97ea-552871d55d6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:23.657051 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-00b32b67-9bc1-4a68-97ea-552871d55d6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:23.657480 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-00b32b67-9bc1-4a68-97ea-552871d55d6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:23.658163 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-00b32b67-9bc1-4a68-97ea-552871d55d6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:23.658610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-00b32b67-9bc1-4a68-97ea-552871d55d6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:23.659050 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-00b32b67-9bc1-4a68-97ea-552871d55d6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:23.786688 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-00b32b67-9bc1-4a68-97ea-552871d55d6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:23.794983 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-00b32b67-9bc1-4a68-97ea-552871d55d6a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1510 microversion: 2.1 time: 0.149819 Aug 29 19:04:23.795555 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 185/382] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:23 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:24.089912 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a05aa6b8-a00a-4753-b5a1-c709a11b4170 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:24.090517 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a05aa6b8-a00a-4753-b5a1-c709a11b4170 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:24.097036 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a05aa6b8-a00a-4753-b5a1-c709a11b4170 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:24.097506 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a05aa6b8-a00a-4753-b5a1-c709a11b4170 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:24.097932 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a05aa6b8-a00a-4753-b5a1-c709a11b4170 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:24.098606 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a05aa6b8-a00a-4753-b5a1-c709a11b4170 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:24.099085 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a05aa6b8-a00a-4753-b5a1-c709a11b4170 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:24.099502 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a05aa6b8-a00a-4753-b5a1-c709a11b4170 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:24.227079 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a05aa6b8-a00a-4753-b5a1-c709a11b4170 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:24.235109 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a05aa6b8-a00a-4753-b5a1-c709a11b4170 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.149030 Aug 29 19:04:24.235656 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 198/383] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:24 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:24.815948 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f54cec90-5cc0-4a3b-8da8-8aafe2eb8af3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:24.816543 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f54cec90-5cc0-4a3b-8da8-8aafe2eb8af3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:24.823089 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f54cec90-5cc0-4a3b-8da8-8aafe2eb8af3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:24.823573 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f54cec90-5cc0-4a3b-8da8-8aafe2eb8af3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:24.824008 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f54cec90-5cc0-4a3b-8da8-8aafe2eb8af3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:24.824814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f54cec90-5cc0-4a3b-8da8-8aafe2eb8af3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:24.825761 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f54cec90-5cc0-4a3b-8da8-8aafe2eb8af3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:24.826178 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f54cec90-5cc0-4a3b-8da8-8aafe2eb8af3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:24.969927 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f54cec90-5cc0-4a3b-8da8-8aafe2eb8af3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:24.977543 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f54cec90-5cc0-4a3b-8da8-8aafe2eb8af3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1510 microversion: 2.1 time: 0.165455 Aug 29 19:04:24.978103 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 186/384] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:24 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:25.254791 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9a70ab11-7e34-4327-b5a2-c8196b08d7ca tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:25.255349 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9a70ab11-7e34-4327-b5a2-c8196b08d7ca tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:25.261369 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a70ab11-7e34-4327-b5a2-c8196b08d7ca tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:25.261891 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a70ab11-7e34-4327-b5a2-c8196b08d7ca tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:25.262321 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a70ab11-7e34-4327-b5a2-c8196b08d7ca tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:25.263091 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a70ab11-7e34-4327-b5a2-c8196b08d7ca tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:25.264141 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a70ab11-7e34-4327-b5a2-c8196b08d7ca tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:25.264590 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a70ab11-7e34-4327-b5a2-c8196b08d7ca tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:25.395566 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9a70ab11-7e34-4327-b5a2-c8196b08d7ca tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:25.403619 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9a70ab11-7e34-4327-b5a2-c8196b08d7ca tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.152731 Aug 29 19:04:25.404183 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 199/385] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:25 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:25.998106 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-97a69408-e251-4f01-9c76-f0acad1d39ac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:25.998709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-97a69408-e251-4f01-9c76-f0acad1d39ac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:26.005166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97a69408-e251-4f01-9c76-f0acad1d39ac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:26.005639 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97a69408-e251-4f01-9c76-f0acad1d39ac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:26.006066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97a69408-e251-4f01-9c76-f0acad1d39ac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:26.006745 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97a69408-e251-4f01-9c76-f0acad1d39ac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:26.007219 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97a69408-e251-4f01-9c76-f0acad1d39ac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:26.007639 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97a69408-e251-4f01-9c76-f0acad1d39ac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:26.025710 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:26.143125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-97a69408-e251-4f01-9c76-f0acad1d39ac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:26.152259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-97a69408-e251-4f01-9c76-f0acad1d39ac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1510 microversion: 2.1 time: 0.158267 Aug 29 19:04:26.152827 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 187/386] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:25 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:26.424649 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7e0c36c4-2964-4bc5-9500-eddb46510c90 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:26.425265 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7e0c36c4-2964-4bc5-9500-eddb46510c90 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:26.431295 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e0c36c4-2964-4bc5-9500-eddb46510c90 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:26.431766 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e0c36c4-2964-4bc5-9500-eddb46510c90 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:26.432200 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e0c36c4-2964-4bc5-9500-eddb46510c90 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:26.432888 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e0c36c4-2964-4bc5-9500-eddb46510c90 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:26.433344 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e0c36c4-2964-4bc5-9500-eddb46510c90 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:26.433768 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e0c36c4-2964-4bc5-9500-eddb46510c90 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:26.562400 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7e0c36c4-2964-4bc5-9500-eddb46510c90 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:26.570160 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7e0c36c4-2964-4bc5-9500-eddb46510c90 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.149619 Aug 29 19:04:26.570712 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 200/387] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:26 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:27.177117 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2ce1d3a0-d35e-494f-a592-1076b94e4571 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:27.177761 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2ce1d3a0-d35e-494f-a592-1076b94e4571 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:27.184229 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ce1d3a0-d35e-494f-a592-1076b94e4571 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:27.184709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ce1d3a0-d35e-494f-a592-1076b94e4571 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:27.185140 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ce1d3a0-d35e-494f-a592-1076b94e4571 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:27.185822 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ce1d3a0-d35e-494f-a592-1076b94e4571 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:27.186270 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ce1d3a0-d35e-494f-a592-1076b94e4571 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:27.186706 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ce1d3a0-d35e-494f-a592-1076b94e4571 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:27.316582 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2ce1d3a0-d35e-494f-a592-1076b94e4571 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:27.324579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2ce1d3a0-d35e-494f-a592-1076b94e4571 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1510 microversion: 2.1 time: 0.151399 Aug 29 19:04:27.325633 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 188/388] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:27 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:27.590317 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-54418a82-d950-407b-ac9f-fee74c87a786 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:27.592311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-54418a82-d950-407b-ac9f-fee74c87a786 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:27.598713 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54418a82-d950-407b-ac9f-fee74c87a786 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:27.599177 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54418a82-d950-407b-ac9f-fee74c87a786 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:27.599612 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54418a82-d950-407b-ac9f-fee74c87a786 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:27.600520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54418a82-d950-407b-ac9f-fee74c87a786 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:27.601089 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54418a82-d950-407b-ac9f-fee74c87a786 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:27.601503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54418a82-d950-407b-ac9f-fee74c87a786 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:27.744225 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-54418a82-d950-407b-ac9f-fee74c87a786 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:27.752460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-54418a82-d950-407b-ac9f-fee74c87a786 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.166227 Aug 29 19:04:27.753001 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 201/389] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:27 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:28.346058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f42f342a-a680-43f3-9b70-11b7ac3e2810 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:28.346802 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f42f342a-a680-43f3-9b70-11b7ac3e2810 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:28.354618 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f42f342a-a680-43f3-9b70-11b7ac3e2810 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:28.355320 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f42f342a-a680-43f3-9b70-11b7ac3e2810 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:28.355824 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f42f342a-a680-43f3-9b70-11b7ac3e2810 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:28.357757 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f42f342a-a680-43f3-9b70-11b7ac3e2810 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:28.358391 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f42f342a-a680-43f3-9b70-11b7ac3e2810 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:28.360893 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f42f342a-a680-43f3-9b70-11b7ac3e2810 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:28.497416 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f42f342a-a680-43f3-9b70-11b7ac3e2810 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:28.505219 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f42f342a-a680-43f3-9b70-11b7ac3e2810 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1510 microversion: 2.1 time: 0.162987 Aug 29 19:04:28.505810 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 189/390] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:28 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:28.772983 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bc77ed0a-5654-4177-b791-b4feda6ff542 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:28.773621 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bc77ed0a-5654-4177-b791-b4feda6ff542 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:28.780251 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc77ed0a-5654-4177-b791-b4feda6ff542 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:28.780732 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc77ed0a-5654-4177-b791-b4feda6ff542 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:28.781167 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc77ed0a-5654-4177-b791-b4feda6ff542 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:28.781850 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc77ed0a-5654-4177-b791-b4feda6ff542 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:28.782299 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc77ed0a-5654-4177-b791-b4feda6ff542 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:28.782716 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc77ed0a-5654-4177-b791-b4feda6ff542 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:28.910980 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bc77ed0a-5654-4177-b791-b4feda6ff542 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:28.918765 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bc77ed0a-5654-4177-b791-b4feda6ff542 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.149654 Aug 29 19:04:28.919500 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 202/391] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:28 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:04:29.527052 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-12bbc456-cf29-4683-b106-5af637f65ad7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:29.527658 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-12bbc456-cf29-4683-b106-5af637f65ad7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:29.530000 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=50 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:29.535390 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12bbc456-cf29-4683-b106-5af637f65ad7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:29.535871 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12bbc456-cf29-4683-b106-5af637f65ad7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:29.536302 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12bbc456-cf29-4683-b106-5af637f65ad7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:29.536981 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12bbc456-cf29-4683-b106-5af637f65ad7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:29.537426 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12bbc456-cf29-4683-b106-5af637f65ad7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:29.537839 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12bbc456-cf29-4683-b106-5af637f65ad7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:29.667687 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-12bbc456-cf29-4683-b106-5af637f65ad7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:29.675357 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-12bbc456-cf29-4683-b106-5af637f65ad7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1510 microversion: 2.1 time: 0.152229 Aug 29 19:04:29.687089 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 190/392] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:29 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:29.939277 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0e721dd2-4295-4fa2-8659-2f6dd6c83bed tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:29.939790 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0e721dd2-4295-4fa2-8659-2f6dd6c83bed tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:29.945909 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e721dd2-4295-4fa2-8659-2f6dd6c83bed tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:29.946390 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e721dd2-4295-4fa2-8659-2f6dd6c83bed tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:29.946815 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e721dd2-4295-4fa2-8659-2f6dd6c83bed tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:29.947522 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e721dd2-4295-4fa2-8659-2f6dd6c83bed tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:29.947970 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e721dd2-4295-4fa2-8659-2f6dd6c83bed tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:29.948390 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e721dd2-4295-4fa2-8659-2f6dd6c83bed tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:30.078102 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0e721dd2-4295-4fa2-8659-2f6dd6c83bed tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:30.085691 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0e721dd2-4295-4fa2-8659-2f6dd6c83bed tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.150361 Aug 29 19:04:30.086250 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 203/393] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:29 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:30.697949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-67d381e8-053a-4a07-bb5c-5559dfcf6764 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:30.698548 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-67d381e8-053a-4a07-bb5c-5559dfcf6764 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:30.706434 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67d381e8-053a-4a07-bb5c-5559dfcf6764 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:30.706917 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67d381e8-053a-4a07-bb5c-5559dfcf6764 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:30.707377 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67d381e8-053a-4a07-bb5c-5559dfcf6764 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:30.708064 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67d381e8-053a-4a07-bb5c-5559dfcf6764 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:30.708704 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67d381e8-053a-4a07-bb5c-5559dfcf6764 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:30.709128 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67d381e8-053a-4a07-bb5c-5559dfcf6764 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:30.839783 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-67d381e8-053a-4a07-bb5c-5559dfcf6764 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:30.847285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-67d381e8-053a-4a07-bb5c-5559dfcf6764 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1510 microversion: 2.1 time: 0.153176 Aug 29 19:04:30.847838 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 191/394] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:30 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:31.163450 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3cd47724-955a-4611-b59f-b735ea11faa6 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:31.164063 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3cd47724-955a-4611-b59f-b735ea11faa6 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:31.170825 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3cd47724-955a-4611-b59f-b735ea11faa6 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:31.171346 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3cd47724-955a-4611-b59f-b735ea11faa6 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:31.171778 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3cd47724-955a-4611-b59f-b735ea11faa6 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:31.172460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3cd47724-955a-4611-b59f-b735ea11faa6 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:31.172912 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3cd47724-955a-4611-b59f-b735ea11faa6 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:31.173359 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3cd47724-955a-4611-b59f-b735ea11faa6 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:31.298153 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3cd47724-955a-4611-b59f-b735ea11faa6 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:31.305753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3cd47724-955a-4611-b59f-b735ea11faa6 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.146135 Aug 29 19:04:31.306313 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 204/395] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:31 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:31.868448 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f95c5eec-ab80-49d3-b472-5874d20b8327 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:31.869049 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f95c5eec-ab80-49d3-b472-5874d20b8327 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:31.875527 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f95c5eec-ab80-49d3-b472-5874d20b8327 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:31.876031 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f95c5eec-ab80-49d3-b472-5874d20b8327 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:31.876459 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f95c5eec-ab80-49d3-b472-5874d20b8327 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:31.877133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f95c5eec-ab80-49d3-b472-5874d20b8327 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:31.877577 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f95c5eec-ab80-49d3-b472-5874d20b8327 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:31.877992 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f95c5eec-ab80-49d3-b472-5874d20b8327 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:32.006431 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f95c5eec-ab80-49d3-b472-5874d20b8327 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:32.014057 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f95c5eec-ab80-49d3-b472-5874d20b8327 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1510 microversion: 2.1 time: 0.149457 Aug 29 19:04:32.014620 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 192/396] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:31 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:32.327914 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0d7f4504-0cc3-4add-860e-c87b66da5486 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:32.328531 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0d7f4504-0cc3-4add-860e-c87b66da5486 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:32.334548 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d7f4504-0cc3-4add-860e-c87b66da5486 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:32.335055 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d7f4504-0cc3-4add-860e-c87b66da5486 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:32.335494 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d7f4504-0cc3-4add-860e-c87b66da5486 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:32.336180 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d7f4504-0cc3-4add-860e-c87b66da5486 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:32.336632 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d7f4504-0cc3-4add-860e-c87b66da5486 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:32.337057 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d7f4504-0cc3-4add-860e-c87b66da5486 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:32.463328 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0d7f4504-0cc3-4add-860e-c87b66da5486 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:32.471899 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0d7f4504-0cc3-4add-860e-c87b66da5486 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.148498 Aug 29 19:04:32.472460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 205/397] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:32 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:33.035218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-18e4d260-1159-4e7c-8ad7-610cd505f7a8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:33.035827 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-18e4d260-1159-4e7c-8ad7-610cd505f7a8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:33.042237 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-18e4d260-1159-4e7c-8ad7-610cd505f7a8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:33.042809 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-18e4d260-1159-4e7c-8ad7-610cd505f7a8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:33.043263 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-18e4d260-1159-4e7c-8ad7-610cd505f7a8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:33.044466 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-18e4d260-1159-4e7c-8ad7-610cd505f7a8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:33.044912 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-18e4d260-1159-4e7c-8ad7-610cd505f7a8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:33.045327 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-18e4d260-1159-4e7c-8ad7-610cd505f7a8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:33.178742 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-18e4d260-1159-4e7c-8ad7-610cd505f7a8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:33.186944 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-18e4d260-1159-4e7c-8ad7-610cd505f7a8 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1510 microversion: 2.1 time: 0.155716 Aug 29 19:04:33.187520 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 193/398] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:33 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:33.491827 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d50fc932-0d9e-4e48-800d-ba056853bec3 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:33.492433 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d50fc932-0d9e-4e48-800d-ba056853bec3 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:33.498336 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d50fc932-0d9e-4e48-800d-ba056853bec3 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:33.498815 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d50fc932-0d9e-4e48-800d-ba056853bec3 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:33.499280 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d50fc932-0d9e-4e48-800d-ba056853bec3 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:33.499957 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d50fc932-0d9e-4e48-800d-ba056853bec3 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:33.500405 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d50fc932-0d9e-4e48-800d-ba056853bec3 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:33.500820 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d50fc932-0d9e-4e48-800d-ba056853bec3 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:33.515168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:33.630765 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d50fc932-0d9e-4e48-800d-ba056853bec3 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:33.638304 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d50fc932-0d9e-4e48-800d-ba056853bec3 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.150273 Aug 29 19:04:33.638858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 206/399] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:33 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:34.029994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-489f727f-1006-4962-860c-c3cabfec5fb6 req-afa73e6f-e089-4248-9124-d194aba2067e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a", "name": "network-vif-plugged", "status": "completed", "tag": "84f5da8e-f9f0-4484-aaeb-d86ac78c367b"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:04:34.041121 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-489f727f-1006-4962-860c-c3cabfec5fb6 req-afa73e6f-e089-4248-9124-d194aba2067e service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:34.041685 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-489f727f-1006-4962-860c-c3cabfec5fb6 req-afa73e6f-e089-4248-9124-d194aba2067e service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:34.042097 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-489f727f-1006-4962-860c-c3cabfec5fb6 req-afa73e6f-e089-4248-9124-d194aba2067e service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:34.053766 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-489f727f-1006-4962-860c-c3cabfec5fb6 req-afa73e6f-e089-4248-9124-d194aba2067e service nova] Creating event network-vif-plugged:84f5da8e-f9f0-4484-aaeb-d86ac78c367b for instance 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a on hv-cinder-85083 Aug 29 19:04:34.059253 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-489f727f-1006-4962-860c-c3cabfec5fb6 req-afa73e6f-e089-4248-9124-d194aba2067e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033666 Aug 29 19:04:34.060213 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 194/400] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:04:34.207411 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e775e4a6-8f42-46d1-9d85-467ee28524de tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:34.208021 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e775e4a6-8f42-46d1-9d85-467ee28524de tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:34.214400 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e775e4a6-8f42-46d1-9d85-467ee28524de tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:34.214913 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e775e4a6-8f42-46d1-9d85-467ee28524de tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:34.215498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e775e4a6-8f42-46d1-9d85-467ee28524de tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:34.216218 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e775e4a6-8f42-46d1-9d85-467ee28524de tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:34.216671 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e775e4a6-8f42-46d1-9d85-467ee28524de tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:34.217112 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e775e4a6-8f42-46d1-9d85-467ee28524de tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:34.361948 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e775e4a6-8f42-46d1-9d85-467ee28524de tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:34.370041 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e775e4a6-8f42-46d1-9d85-467ee28524de tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1510 microversion: 2.1 time: 0.166448 Aug 29 19:04:34.370932 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 207/401] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:34 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:34.659269 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-51d9c22e-8c1d-4ef7-a79e-78cfb2bfa83f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:34.659991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-51d9c22e-8c1d-4ef7-a79e-78cfb2bfa83f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:34.666332 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-51d9c22e-8c1d-4ef7-a79e-78cfb2bfa83f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:34.666847 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-51d9c22e-8c1d-4ef7-a79e-78cfb2bfa83f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:34.667309 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-51d9c22e-8c1d-4ef7-a79e-78cfb2bfa83f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:34.668007 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-51d9c22e-8c1d-4ef7-a79e-78cfb2bfa83f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:34.668461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-51d9c22e-8c1d-4ef7-a79e-78cfb2bfa83f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:34.669368 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-51d9c22e-8c1d-4ef7-a79e-78cfb2bfa83f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:34.817326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-51d9c22e-8c1d-4ef7-a79e-78cfb2bfa83f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:34.826559 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-51d9c22e-8c1d-4ef7-a79e-78cfb2bfa83f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.171363 Aug 29 19:04:34.827224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 195/402] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:34 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:35.393073 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6cb2b8d2-5ea2-4a23-8a29-ecf6907ff630 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:35.395311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6cb2b8d2-5ea2-4a23-8a29-ecf6907ff630 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:35.411147 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6cb2b8d2-5ea2-4a23-8a29-ecf6907ff630 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:35.411695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6cb2b8d2-5ea2-4a23-8a29-ecf6907ff630 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:35.412139 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6cb2b8d2-5ea2-4a23-8a29-ecf6907ff630 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:35.412852 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6cb2b8d2-5ea2-4a23-8a29-ecf6907ff630 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:35.413311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6cb2b8d2-5ea2-4a23-8a29-ecf6907ff630 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:35.413737 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6cb2b8d2-5ea2-4a23-8a29-ecf6907ff630 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:35.607964 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6cb2b8d2-5ea2-4a23-8a29-ecf6907ff630 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:35.615769 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6cb2b8d2-5ea2-4a23-8a29-ecf6907ff630 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1510 microversion: 2.1 time: 0.228072 Aug 29 19:04:35.616403 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 208/403] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:35 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:35.847327 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-40b3c0aa-596e-402a-a7aa-f8f40896ed67 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:35.849273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-40b3c0aa-596e-402a-a7aa-f8f40896ed67 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:35.856123 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40b3c0aa-596e-402a-a7aa-f8f40896ed67 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:35.856698 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40b3c0aa-596e-402a-a7aa-f8f40896ed67 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:35.857305 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40b3c0aa-596e-402a-a7aa-f8f40896ed67 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:35.857996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40b3c0aa-596e-402a-a7aa-f8f40896ed67 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:35.858603 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40b3c0aa-596e-402a-a7aa-f8f40896ed67 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:35.859161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40b3c0aa-596e-402a-a7aa-f8f40896ed67 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:36.027367 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-40b3c0aa-596e-402a-a7aa-f8f40896ed67 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:36.035276 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-40b3c0aa-596e-402a-a7aa-f8f40896ed67 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.192290 Aug 29 19:04:36.035842 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 196/404] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:35 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:36.638101 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-613c4835-72b6-403a-bf2f-963d2e391257 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:36.638718 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-613c4835-72b6-403a-bf2f-963d2e391257 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:36.649224 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-613c4835-72b6-403a-bf2f-963d2e391257 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:36.650323 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-613c4835-72b6-403a-bf2f-963d2e391257 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:36.651153 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-613c4835-72b6-403a-bf2f-963d2e391257 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:36.652123 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-613c4835-72b6-403a-bf2f-963d2e391257 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:36.653710 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-613c4835-72b6-403a-bf2f-963d2e391257 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:36.654202 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-613c4835-72b6-403a-bf2f-963d2e391257 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:36.813701 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-613c4835-72b6-403a-bf2f-963d2e391257 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:36.821546 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-613c4835-72b6-403a-bf2f-963d2e391257 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1516 microversion: 2.1 time: 0.187625 Aug 29 19:04:36.822278 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 209/405] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:36 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1516 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:37.058499 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c99c5163-dc4e-4f49-b6ff-e25a08388039 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:37.060070 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c99c5163-dc4e-4f49-b6ff-e25a08388039 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:37.069386 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c99c5163-dc4e-4f49-b6ff-e25a08388039 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:37.069871 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c99c5163-dc4e-4f49-b6ff-e25a08388039 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:37.070548 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c99c5163-dc4e-4f49-b6ff-e25a08388039 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:37.071080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c99c5163-dc4e-4f49-b6ff-e25a08388039 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:37.071536 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c99c5163-dc4e-4f49-b6ff-e25a08388039 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:37.071958 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c99c5163-dc4e-4f49-b6ff-e25a08388039 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:37.215251 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c99c5163-dc4e-4f49-b6ff-e25a08388039 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:37.223110 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c99c5163-dc4e-4f49-b6ff-e25a08388039 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.170369 Aug 29 19:04:37.223854 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 197/406] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:37 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:38.244734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-166246b3-85ff-45c2-ad3a-b99fe277041a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:38.245345 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-166246b3-85ff-45c2-ad3a-b99fe277041a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:38.251277 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-166246b3-85ff-45c2-ad3a-b99fe277041a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:38.251787 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-166246b3-85ff-45c2-ad3a-b99fe277041a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:38.252243 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-166246b3-85ff-45c2-ad3a-b99fe277041a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:38.252920 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-166246b3-85ff-45c2-ad3a-b99fe277041a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:38.253374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-166246b3-85ff-45c2-ad3a-b99fe277041a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:38.253792 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-166246b3-85ff-45c2-ad3a-b99fe277041a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:38.385192 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-166246b3-85ff-45c2-ad3a-b99fe277041a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:38.393199 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-166246b3-85ff-45c2-ad3a-b99fe277041a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.152315 Aug 29 19:04:38.393748 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 210/407] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:38 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:39.415136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1c921fe1-64ac-4ca0-b85f-351c34948e7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:39.415675 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1c921fe1-64ac-4ca0-b85f-351c34948e7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:39.425528 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c921fe1-64ac-4ca0-b85f-351c34948e7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:39.426028 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c921fe1-64ac-4ca0-b85f-351c34948e7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:39.426528 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c921fe1-64ac-4ca0-b85f-351c34948e7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:39.427269 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c921fe1-64ac-4ca0-b85f-351c34948e7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:39.427730 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c921fe1-64ac-4ca0-b85f-351c34948e7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:39.428162 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c921fe1-64ac-4ca0-b85f-351c34948e7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:39.558223 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1c921fe1-64ac-4ca0-b85f-351c34948e7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:39.565781 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1c921fe1-64ac-4ca0-b85f-351c34948e7a tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.154762 Aug 29 19:04:39.566327 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 198/408] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:39 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:40.585410 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6b1b10f0-d475-439a-94b3-5a2b5816b669 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:40.586011 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6b1b10f0-d475-439a-94b3-5a2b5816b669 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:40.587922 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:40.593699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b1b10f0-d475-439a-94b3-5a2b5816b669 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:40.594168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b1b10f0-d475-439a-94b3-5a2b5816b669 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:40.594601 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b1b10f0-d475-439a-94b3-5a2b5816b669 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:40.595452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b1b10f0-d475-439a-94b3-5a2b5816b669 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:40.595903 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b1b10f0-d475-439a-94b3-5a2b5816b669 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:40.596319 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b1b10f0-d475-439a-94b3-5a2b5816b669 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:40.725991 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6b1b10f0-d475-439a-94b3-5a2b5816b669 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:40.733994 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6b1b10f0-d475-439a-94b3-5a2b5816b669 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.152401 Aug 29 19:04:40.734540 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 211/409] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:40 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:41.753901 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-19404c56-be61-4198-9ea2-4a5e96e6e663 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:41.754507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-19404c56-be61-4198-9ea2-4a5e96e6e663 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:41.760846 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19404c56-be61-4198-9ea2-4a5e96e6e663 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:41.761325 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19404c56-be61-4198-9ea2-4a5e96e6e663 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:41.761780 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19404c56-be61-4198-9ea2-4a5e96e6e663 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:41.762486 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19404c56-be61-4198-9ea2-4a5e96e6e663 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:41.762939 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19404c56-be61-4198-9ea2-4a5e96e6e663 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:41.763384 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19404c56-be61-4198-9ea2-4a5e96e6e663 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:41.898069 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-19404c56-be61-4198-9ea2-4a5e96e6e663 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:41.906288 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-19404c56-be61-4198-9ea2-4a5e96e6e663 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1314 microversion: 2.1 time: 0.156519 Aug 29 19:04:41.906855 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 199/410] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:41 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:42.927909 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bd1f8c55-aed3-4507-8759-a9d4d0703922 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:42.928587 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bd1f8c55-aed3-4507-8759-a9d4d0703922 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:42.934497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bd1f8c55-aed3-4507-8759-a9d4d0703922 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:42.934973 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bd1f8c55-aed3-4507-8759-a9d4d0703922 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:42.935482 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bd1f8c55-aed3-4507-8759-a9d4d0703922 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:42.936426 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bd1f8c55-aed3-4507-8759-a9d4d0703922 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:42.936882 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bd1f8c55-aed3-4507-8759-a9d4d0703922 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:42.937301 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bd1f8c55-aed3-4507-8759-a9d4d0703922 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:43.067274 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bd1f8c55-aed3-4507-8759-a9d4d0703922 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:43.075155 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bd1f8c55-aed3-4507-8759-a9d4d0703922 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1463 microversion: 2.1 time: 0.150974 Aug 29 19:04:43.076204 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 212/411] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:42 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1463 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:43.119926 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2656522b-1459-415a-af56-045c420af71f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:43.120425 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2656522b-1459-415a-af56-045c420af71f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:43.127292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2656522b-1459-415a-af56-045c420af71f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:43.127772 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2656522b-1459-415a-af56-045c420af71f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:43.128196 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2656522b-1459-415a-af56-045c420af71f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:43.128897 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2656522b-1459-415a-af56-045c420af71f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:43.129343 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2656522b-1459-415a-af56-045c420af71f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:43.129757 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2656522b-1459-415a-af56-045c420af71f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:43.156737 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2656522b-1459-415a-af56-045c420af71f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:04:43.229265 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2656522b-1459-415a-af56-045c420af71f tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "DELETE /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 204 len: 0 microversion: 2.1 time: 0.112822 Aug 29 19:04:43.229752 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 200/412] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:04:43 2022] DELETE /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:04:43.238025 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5b9cf938-ed2f-4b97-b341-87e761beb4a2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:43.238637 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5b9cf938-ed2f-4b97-b341-87e761beb4a2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:43.244527 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b9cf938-ed2f-4b97-b341-87e761beb4a2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:43.244984 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b9cf938-ed2f-4b97-b341-87e761beb4a2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:43.245411 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b9cf938-ed2f-4b97-b341-87e761beb4a2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:43.246133 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b9cf938-ed2f-4b97-b341-87e761beb4a2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:43.246582 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b9cf938-ed2f-4b97-b341-87e761beb4a2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:43.246990 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b9cf938-ed2f-4b97-b341-87e761beb4a2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:43.388741 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5b9cf938-ed2f-4b97-b341-87e761beb4a2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:43.396749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5b9cf938-ed2f-4b97-b341-87e761beb4a2 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1469 microversion: 2.1 time: 0.162518 Aug 29 19:04:43.397348 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 213/413] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:43 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:04:43.476013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0f0bffd4-0031-47ea-ba04-9a4d8dc467bc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Action: 'create', calling method: .version_select at 0x7fb2ba0264c0>, body: {"keypair": {"name": "tempest-keypair-1745034498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsZWaxA7dtP9kZtuTM9dPCY60RF90UAbUek+dRp+LMXzrKaC+Nkb4RY3sjRKoO5cAuuQ458T7vBrmlc2L4f0r651Fe/yjcTgWDKXSi7RhQg5FDP5NW2tCKW5EaV10+dqw=="}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:04:43.478715 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-676939953", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452", "networks": [{"uuid": "8cb6cbd2-2df4-4030-a2ff-e7d302b28d1a"}]}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:04:43.491986 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-0f0bffd4-0031-47ea-ba04-9a4d8dc467bc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Getting quotas for project 4f32b60f5fa8427386bafa1a91f4e608. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:04:43.495721 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-0f0bffd4-0031-47ea-ba04-9a4d8dc467bc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Getting quotas for user 962284e9a353430881bc119e5f80a890 and project 4f32b60f5fa8427386bafa1a91f4e608. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:04:43.519882 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0f0bffd4-0031-47ea-ba04-9a4d8dc467bc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049289 Aug 29 19:04:43.520472 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 201/414] 10.222.0.86 () {60 vars in 1159 bytes} [Mon Aug 29 19:04:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:04:43.535344 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] validate_networks() for [('8cb6cbd2-2df4-4030-a2ff-e7d302b28d1a', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:04:43.993485 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:04:43.994055 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:04:43.994523 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:04:43.994932 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:04:43.995377 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:04:44.004926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:44.005341 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:44.005798 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:44.006523 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:44.006974 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:44.007416 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:44.024706 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Getting quotas for project 7918fb7f8aea4f58857307485bc09ec6. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:04:44.028707 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Getting quotas for user 98e853439341466dbea3a535ca13d12b and project 7918fb7f8aea4f58857307485bc09ec6. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:04:44.040319 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:04:44.042612 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:04:44.094398 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f2be0aaf-8a5d-46e9-aa42-ed78b4c4c2b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619446 Aug 29 19:04:44.095068 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 214/415] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:04:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:04:44.106013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-03db4640-1610-4f50-ba15-122ed019d1ea tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:44.107030 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-03db4640-1610-4f50-ba15-122ed019d1ea tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:44.418696 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-54a7834f-a34b-4046-b690-e91a8257434e tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:44.420012 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-54a7834f-a34b-4046-b690-e91a8257434e tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:44.430677 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54a7834f-a34b-4046-b690-e91a8257434e tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:44.431221 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54a7834f-a34b-4046-b690-e91a8257434e tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:44.431664 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54a7834f-a34b-4046-b690-e91a8257434e tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:44.432404 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54a7834f-a34b-4046-b690-e91a8257434e tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:44.432904 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54a7834f-a34b-4046-b690-e91a8257434e tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:44.438717 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54a7834f-a34b-4046-b690-e91a8257434e tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:44.450185 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-03db4640-1610-4f50-ba15-122ed019d1ea tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:44.472422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-03db4640-1610-4f50-ba15-122ed019d1ea tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1218 microversion: 2.1 time: 0.370508 Aug 29 19:04:44.473291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 202/416] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:44 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1218 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:44.660729 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-54a7834f-a34b-4046-b690-e91a8257434e tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:44.672172 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-54a7834f-a34b-4046-b690-e91a8257434e tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1469 microversion: 2.1 time: 0.257986 Aug 29 19:04:44.673434 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 215/417] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:44 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1469 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:04:45.444877 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-906973414", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64d4415d-fe7c-4b7e-99ee-4cb6a31bf961"}], "security_groups": [{"name": "tempest-securitygroup--1422661682"}], "key_name": "tempest-keypair-1745034498", "user_data": "}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:04:45.494016 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-87fb0f60-3b94-4b00-abf6-64d2e1663f90 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:45.494772 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-87fb0f60-3b94-4b00-abf6-64d2e1663f90 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:45.501492 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-87fb0f60-3b94-4b00-abf6-64d2e1663f90 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:45.501983 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-87fb0f60-3b94-4b00-abf6-64d2e1663f90 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:45.502890 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-87fb0f60-3b94-4b00-abf6-64d2e1663f90 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:45.503394 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-87fb0f60-3b94-4b00-abf6-64d2e1663f90 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:45.503866 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-87fb0f60-3b94-4b00-abf6-64d2e1663f90 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:45.504293 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-87fb0f60-3b94-4b00-abf6-64d2e1663f90 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:45.627993 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-87fb0f60-3b94-4b00-abf6-64d2e1663f90 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:45.636768 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-87fb0f60-3b94-4b00-abf6-64d2e1663f90 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1270 microversion: 2.1 time: 0.147182 Aug 29 19:04:45.651136 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 216/418] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:45 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:45.652111 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] validate_networks() for [('64d4415d-fe7c-4b7e-99ee-4cb6a31bf961', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:04:45.696165 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f15aa073-3d7d-477e-b420-cbe2ba6de706 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:45.696978 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f15aa073-3d7d-477e-b420-cbe2ba6de706 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:45.704078 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f15aa073-3d7d-477e-b420-cbe2ba6de706 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:45.704667 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f15aa073-3d7d-477e-b420-cbe2ba6de706 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:45.705200 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f15aa073-3d7d-477e-b420-cbe2ba6de706 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:45.705992 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f15aa073-3d7d-477e-b420-cbe2ba6de706 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:45.706563 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f15aa073-3d7d-477e-b420-cbe2ba6de706 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:45.707208 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f15aa073-3d7d-477e-b420-cbe2ba6de706 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:46.057591 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f15aa073-3d7d-477e-b420-cbe2ba6de706 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:46.067027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f15aa073-3d7d-477e-b420-cbe2ba6de706 tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1469 microversion: 2.1 time: 0.375244 Aug 29 19:04:46.067839 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 217/419] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:45 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1469 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:46.265824 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-4827e034-b823-4cb6-8dc3-ce9adce88fb0 req-19b54113-aa61-450b-96fc-40e9a6f28f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a", "name": "network-vif-deleted", "tag": "84f5da8e-f9f0-4484-aaeb-d86ac78c367b"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:04:46.285835 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-4827e034-b823-4cb6-8dc3-ce9adce88fb0 req-19b54113-aa61-450b-96fc-40e9a6f28f73 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:46.286741 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-4827e034-b823-4cb6-8dc3-ce9adce88fb0 req-19b54113-aa61-450b-96fc-40e9a6f28f73 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:46.287355 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-4827e034-b823-4cb6-8dc3-ce9adce88fb0 req-19b54113-aa61-450b-96fc-40e9a6f28f73 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:46.305373 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-4827e034-b823-4cb6-8dc3-ce9adce88fb0 req-19b54113-aa61-450b-96fc-40e9a6f28f73 service nova] Creating event network-vif-deleted:84f5da8e-f9f0-4484-aaeb-d86ac78c367b for instance 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a on hv-cinder-85083 Aug 29 19:04:46.317054 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-4827e034-b823-4cb6-8dc3-ce9adce88fb0 req-19b54113-aa61-450b-96fc-40e9a6f28f73 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056195 Aug 29 19:04:46.318294 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 218/420] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:04:46.389794 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:04:46.390175 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:04:46.390681 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:04:46.391411 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:04:46.391937 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:04:46.402846 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:46.403642 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:46.404130 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:46.404936 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:46.405606 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:46.406199 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:46.427621 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Getting quotas for project 4f32b60f5fa8427386bafa1a91f4e608. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:04:46.431629 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Getting quotas for user 962284e9a353430881bc119e5f80a890 and project 4f32b60f5fa8427386bafa1a91f4e608. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:04:46.443419 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:04:46.445975 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:04:46.504728 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-734b1336-1771-43cc-8166-2c54cb6f8b9a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.064474 Aug 29 19:04:46.505669 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 203/421] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:04:45 2022] POST /compute/v2.1/servers => generated 409 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:04:46.517873 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ac2cb165-453f-413a-bb10-9b0e88c9c165 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:46.523160 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ac2cb165-453f-413a-bb10-9b0e88c9c165 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:46.604119 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ac2cb165-453f-413a-bb10-9b0e88c9c165 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:46.615382 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ac2cb165-453f-413a-bb10-9b0e88c9c165 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1245 microversion: 2.1 time: 0.101449 Aug 29 19:04:46.616441 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 219/422] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:46 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1245 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:46.658155 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d6a1b41f-5ebd-4804-8e09-99e9ac60c400 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:46.659377 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d6a1b41f-5ebd-4804-8e09-99e9ac60c400 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:46.667859 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6a1b41f-5ebd-4804-8e09-99e9ac60c400 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:46.668667 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6a1b41f-5ebd-4804-8e09-99e9ac60c400 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:46.669881 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6a1b41f-5ebd-4804-8e09-99e9ac60c400 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:46.670755 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6a1b41f-5ebd-4804-8e09-99e9ac60c400 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:46.671570 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6a1b41f-5ebd-4804-8e09-99e9ac60c400 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:46.672147 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6a1b41f-5ebd-4804-8e09-99e9ac60c400 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:46.822785 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d6a1b41f-5ebd-4804-8e09-99e9ac60c400 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:46.830704 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d6a1b41f-5ebd-4804-8e09-99e9ac60c400 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.176708 Aug 29 19:04:46.831601 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 204/423] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:46 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:47.090629 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-73a3de50-234c-416a-8bf0-a33d61f999aa tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:47.091471 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-73a3de50-234c-416a-8bf0-a33d61f999aa tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:47.098907 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73a3de50-234c-416a-8bf0-a33d61f999aa tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:47.099872 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73a3de50-234c-416a-8bf0-a33d61f999aa tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:47.100313 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73a3de50-234c-416a-8bf0-a33d61f999aa tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:47.101322 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73a3de50-234c-416a-8bf0-a33d61f999aa tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:47.101981 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73a3de50-234c-416a-8bf0-a33d61f999aa tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:47.102550 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73a3de50-234c-416a-8bf0-a33d61f999aa tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:47.141765 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73a3de50-234c-416a-8bf0-a33d61f999aa tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:47.143102 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73a3de50-234c-416a-8bf0-a33d61f999aa tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:47.143826 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73a3de50-234c-416a-8bf0-a33d61f999aa tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:47.144435 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-73a3de50-234c-416a-8bf0-a33d61f999aa tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lazy-loading 'fault' on Instance uuid 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:04:47.192146 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-73a3de50-234c-416a-8bf0-a33d61f999aa tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f11e586dc64a41a84248b4a4c894a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350221a9b0c14c70b92f48cae0d3a838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:47.205134 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-73a3de50-234c-416a-8bf0-a33d61f999aa tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 200 len: 1304 microversion: 2.1 time: 0.117652 Aug 29 19:04:47.207615 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 220/424] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:47 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:47.636938 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ca352e01-414a-4727-8e2b-f4bb43cb0405 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:47.638782 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ca352e01-414a-4727-8e2b-f4bb43cb0405 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:47.647419 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca352e01-414a-4727-8e2b-f4bb43cb0405 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:47.648154 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca352e01-414a-4727-8e2b-f4bb43cb0405 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:47.648579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca352e01-414a-4727-8e2b-f4bb43cb0405 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:47.649580 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca352e01-414a-4727-8e2b-f4bb43cb0405 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:47.650475 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca352e01-414a-4727-8e2b-f4bb43cb0405 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:47.651525 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca352e01-414a-4727-8e2b-f4bb43cb0405 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:47.739945 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ca352e01-414a-4727-8e2b-f4bb43cb0405 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:47.744583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:47.752866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ca352e01-414a-4727-8e2b-f4bb43cb0405 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1297 microversion: 2.1 time: 0.119796 Aug 29 19:04:47.758672 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-819ce8c9-e278-4139-8b3f-429c0e5284f4 req-1e348079-82ef-4d51-bfc6-153a7556b621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1134fbcb-be0a-424d-8e20-abf975209cb1", "tag": "71085a76-18e8-4947-99d8-a14d676237aa"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:04:47.768186 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 205/425] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:47 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1297 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:47.769609 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-819ce8c9-e278-4139-8b3f-429c0e5284f4 req-1e348079-82ef-4d51-bfc6-153a7556b621 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:47.770158 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-819ce8c9-e278-4139-8b3f-429c0e5284f4 req-1e348079-82ef-4d51-bfc6-153a7556b621 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:47.770590 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-819ce8c9-e278-4139-8b3f-429c0e5284f4 req-1e348079-82ef-4d51-bfc6-153a7556b621 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:47.790486 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-819ce8c9-e278-4139-8b3f-429c0e5284f4 req-1e348079-82ef-4d51-bfc6-153a7556b621 service nova] Creating event network-changed:71085a76-18e8-4947-99d8-a14d676237aa for instance 1134fbcb-be0a-424d-8e20-abf975209cb1 on hv-cinder-85083 Aug 29 19:04:47.796331 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-819ce8c9-e278-4139-8b3f-429c0e5284f4 req-1e348079-82ef-4d51-bfc6-153a7556b621 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042109 Aug 29 19:04:47.796929 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 221/426] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:04:47.852903 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6cb7511a-b876-4bb2-af2d-c34f4728df0d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:47.853536 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6cb7511a-b876-4bb2-af2d-c34f4728df0d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:47.861656 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6cb7511a-b876-4bb2-af2d-c34f4728df0d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:47.862138 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6cb7511a-b876-4bb2-af2d-c34f4728df0d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:47.862564 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6cb7511a-b876-4bb2-af2d-c34f4728df0d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:47.863276 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6cb7511a-b876-4bb2-af2d-c34f4728df0d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:47.863724 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6cb7511a-b876-4bb2-af2d-c34f4728df0d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:47.864141 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6cb7511a-b876-4bb2-af2d-c34f4728df0d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:48.007810 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6cb7511a-b876-4bb2-af2d-c34f4728df0d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:48.021261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6cb7511a-b876-4bb2-af2d-c34f4728df0d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.172610 Aug 29 19:04:48.022163 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 206/427] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:47 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:48.229061 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9d4fe5c0-fefb-4c7e-a529-4dd56baa5bea tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:48.229712 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9d4fe5c0-fefb-4c7e-a529-4dd56baa5bea tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] [instance: 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:48.238909 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9d4fe5c0-fefb-4c7e-a529-4dd56baa5bea tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:48.239440 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9d4fe5c0-fefb-4c7e-a529-4dd56baa5bea tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:48.240757 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9d4fe5c0-fefb-4c7e-a529-4dd56baa5bea tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:48.240757 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9d4fe5c0-fefb-4c7e-a529-4dd56baa5bea tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:48.241009 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9d4fe5c0-fefb-4c7e-a529-4dd56baa5bea tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:48.241425 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9d4fe5c0-fefb-4c7e-a529-4dd56baa5bea tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:48.270015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-9d4fe5c0-fefb-4c7e-a529-4dd56baa5bea tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] HTTP exception thrown: Instance 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a could not be found. Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9d4fe5c0-fefb-4c7e-a529-4dd56baa5bea tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Request method failure captured: Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a HTTP/1.1 Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ2nUFuSftzZH8n9FILTxBEfWK4IotnMdWDlxyoxphwjQlY8ZOMTVht-BEbjjBd7A7Ul3G6aQFDy-vkWVczp3LmaMYb2BP6h7AiQ-0CAAf4vHCcheByK77fSrpJ4_9NeMND_50GDtgHJd-8ynmlchQNdV8RsN1RtEP3_BIwe59KKP2I Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: 350221a9b0c14c70b92f48cae0d3a838 Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-VolumesNegativeTest-421877081 Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:04:48.271226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:04:48.272685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/350221a9b0c14c70b92f48cae0d3a838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/350221a9b0c14c70b92f48cae0d3a838"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/350221a9b0c14c70b92f48cae0d3a838"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_350221a9b0c14c70b92f48cae0d3a838"}]}] Aug 29 19:04:48.272685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-VolumesNegativeTest-421877081 Aug 29 19:04:48.272685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 350221a9b0c14c70b92f48cae0d3a838 Aug 29 19:04:48.272685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-VolumesNegativeTest-421877081 Aug 29 19:04:48.272685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-VolumesNegativeTest-421877081-project Aug 29 19:04:48.272685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:04:48.272685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:04:48.272685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: d0f11e586dc64a41a84248b4a4c894a9 Aug 29 19:04:48.272685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-VolumesNegativeTest-421877081-project Aug 29 19:04:48.272685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:04:48.272685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a could not be found. Aug 29 19:04:48.272685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': '1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a'} Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a could not be found. Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:04:48.273666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a could not be found. Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a could not be found. Aug 29 19:04:48.275070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:04:48.277643 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9d4fe5c0-fefb-4c7e-a529-4dd56baa5bea tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] Returning 404 to user: Instance 1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:04:48.279462 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9d4fe5c0-fefb-4c7e-a529-4dd56baa5bea tempest-VolumesNegativeTest-421877081 tempest-VolumesNegativeTest-421877081-project] 10.222.0.86 "GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a" status: 404 len: 111 microversion: 2.1 time: 0.054755 Aug 29 19:04:48.280337 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 222/428] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:48 2022] GET /compute/v2.1/servers/1a2cd5bb-ad26-4f0f-bc93-42c74ee3a39a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:04:48.776536 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-431f8597-7872-4ab0-b734-c718a284a04c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:48.776536 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-431f8597-7872-4ab0-b734-c718a284a04c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:48.787278 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-431f8597-7872-4ab0-b734-c718a284a04c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:48.789888 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-431f8597-7872-4ab0-b734-c718a284a04c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:48.790439 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-431f8597-7872-4ab0-b734-c718a284a04c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:48.791312 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-431f8597-7872-4ab0-b734-c718a284a04c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:48.791869 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-431f8597-7872-4ab0-b734-c718a284a04c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:48.792509 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-431f8597-7872-4ab0-b734-c718a284a04c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:48.921478 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-431f8597-7872-4ab0-b734-c718a284a04c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:48.941285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-431f8597-7872-4ab0-b734-c718a284a04c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1303 microversion: 2.1 time: 0.170406 Aug 29 19:04:48.942468 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 207/429] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:48 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1303 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:49.045307 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5ec50fb1-8f96-4517-92e6-97e78f7b9237 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:49.046608 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5ec50fb1-8f96-4517-92e6-97e78f7b9237 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:49.054934 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ec50fb1-8f96-4517-92e6-97e78f7b9237 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:49.055452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ec50fb1-8f96-4517-92e6-97e78f7b9237 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:49.055884 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ec50fb1-8f96-4517-92e6-97e78f7b9237 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:49.056585 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ec50fb1-8f96-4517-92e6-97e78f7b9237 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:49.057035 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ec50fb1-8f96-4517-92e6-97e78f7b9237 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:49.057460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ec50fb1-8f96-4517-92e6-97e78f7b9237 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:49.350566 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5ec50fb1-8f96-4517-92e6-97e78f7b9237 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:49.363380 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5ec50fb1-8f96-4517-92e6-97e78f7b9237 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.321394 Aug 29 19:04:49.363997 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 223/430] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:49 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:49.968341 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ca726299-a2ac-42d4-a09d-7a2472b6a35b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:49.969331 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ca726299-a2ac-42d4-a09d-7a2472b6a35b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:49.980476 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca726299-a2ac-42d4-a09d-7a2472b6a35b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:49.981280 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca726299-a2ac-42d4-a09d-7a2472b6a35b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:49.982279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca726299-a2ac-42d4-a09d-7a2472b6a35b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:49.982970 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca726299-a2ac-42d4-a09d-7a2472b6a35b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:49.983443 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca726299-a2ac-42d4-a09d-7a2472b6a35b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:49.984060 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca726299-a2ac-42d4-a09d-7a2472b6a35b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:50.127219 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ca726299-a2ac-42d4-a09d-7a2472b6a35b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:50.134764 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ca726299-a2ac-42d4-a09d-7a2472b6a35b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.172095 Aug 29 19:04:50.135455 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 208/431] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:49 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:50.384271 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b287fbe9-db39-40ca-9494-c1a38b092b4b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:50.384884 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b287fbe9-db39-40ca-9494-c1a38b092b4b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:50.391530 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b287fbe9-db39-40ca-9494-c1a38b092b4b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:50.392014 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b287fbe9-db39-40ca-9494-c1a38b092b4b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:50.392447 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b287fbe9-db39-40ca-9494-c1a38b092b4b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:50.393142 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b287fbe9-db39-40ca-9494-c1a38b092b4b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:50.393624 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b287fbe9-db39-40ca-9494-c1a38b092b4b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:50.394085 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b287fbe9-db39-40ca-9494-c1a38b092b4b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:50.545711 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b287fbe9-db39-40ca-9494-c1a38b092b4b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:50.556775 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b287fbe9-db39-40ca-9494-c1a38b092b4b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.176429 Aug 29 19:04:50.557983 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 224/432] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:50 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:51.157609 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b8364b22-93fb-4a40-9bd8-9f16de0c03fc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:51.158287 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b8364b22-93fb-4a40-9bd8-9f16de0c03fc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:51.165014 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8364b22-93fb-4a40-9bd8-9f16de0c03fc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:51.165655 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8364b22-93fb-4a40-9bd8-9f16de0c03fc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:51.166130 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8364b22-93fb-4a40-9bd8-9f16de0c03fc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:51.166840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8364b22-93fb-4a40-9bd8-9f16de0c03fc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:51.167347 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8364b22-93fb-4a40-9bd8-9f16de0c03fc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:51.167779 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8364b22-93fb-4a40-9bd8-9f16de0c03fc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:51.313441 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b8364b22-93fb-4a40-9bd8-9f16de0c03fc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:51.322634 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b8364b22-93fb-4a40-9bd8-9f16de0c03fc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.169122 Aug 29 19:04:51.323363 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 209/433] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:51 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:51.577186 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-31bb7657-c322-4ff7-829b-1b0e69a61450 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:51.577733 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-31bb7657-c322-4ff7-829b-1b0e69a61450 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:51.583791 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31bb7657-c322-4ff7-829b-1b0e69a61450 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:51.584418 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31bb7657-c322-4ff7-829b-1b0e69a61450 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:51.584875 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31bb7657-c322-4ff7-829b-1b0e69a61450 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:51.585545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31bb7657-c322-4ff7-829b-1b0e69a61450 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:51.585989 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31bb7657-c322-4ff7-829b-1b0e69a61450 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:51.587060 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31bb7657-c322-4ff7-829b-1b0e69a61450 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:51.724216 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-31bb7657-c322-4ff7-829b-1b0e69a61450 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:51.732676 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-31bb7657-c322-4ff7-829b-1b0e69a61450 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.159495 Aug 29 19:04:51.733236 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 225/434] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:51 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:52.345235 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ccdba2f9-2bbe-410a-b0e8-a1dbd07fca6c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:52.345991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ccdba2f9-2bbe-410a-b0e8-a1dbd07fca6c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:52.355218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccdba2f9-2bbe-410a-b0e8-a1dbd07fca6c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:52.355700 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccdba2f9-2bbe-410a-b0e8-a1dbd07fca6c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:52.356127 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccdba2f9-2bbe-410a-b0e8-a1dbd07fca6c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:52.357465 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccdba2f9-2bbe-410a-b0e8-a1dbd07fca6c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:52.357911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccdba2f9-2bbe-410a-b0e8-a1dbd07fca6c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:52.358329 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccdba2f9-2bbe-410a-b0e8-a1dbd07fca6c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:52.521213 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ccdba2f9-2bbe-410a-b0e8-a1dbd07fca6c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:52.538741 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ccdba2f9-2bbe-410a-b0e8-a1dbd07fca6c tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.197926 Aug 29 19:04:52.547466 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 210/435] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:52 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:52.753810 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-38360dcd-875b-47bd-8e18-1f0fb85e7cd9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:52.754576 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-38360dcd-875b-47bd-8e18-1f0fb85e7cd9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:52.760562 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38360dcd-875b-47bd-8e18-1f0fb85e7cd9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:52.761339 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38360dcd-875b-47bd-8e18-1f0fb85e7cd9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:52.761833 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38360dcd-875b-47bd-8e18-1f0fb85e7cd9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:52.762901 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38360dcd-875b-47bd-8e18-1f0fb85e7cd9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:52.763526 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38360dcd-875b-47bd-8e18-1f0fb85e7cd9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:52.763945 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38360dcd-875b-47bd-8e18-1f0fb85e7cd9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:52.786857 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:52.996255 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-38360dcd-875b-47bd-8e18-1f0fb85e7cd9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:53.004032 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-38360dcd-875b-47bd-8e18-1f0fb85e7cd9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.254294 Aug 29 19:04:53.004571 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 226/436] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:52 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:53.211635 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-ad7f10e5-fbdb-4260-b2c8-1280dba3ef11 req-8987ccbf-4304-4614-8340-f9267c3ec380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb25d6a-e6bb-4fb7-917c-07041d4509a3", "tag": "769a3c22-a257-4a0e-ab9e-27222b92bfb1"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:04:53.228022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ad7f10e5-fbdb-4260-b2c8-1280dba3ef11 req-8987ccbf-4304-4614-8340-f9267c3ec380 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:53.228613 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ad7f10e5-fbdb-4260-b2c8-1280dba3ef11 req-8987ccbf-4304-4614-8340-f9267c3ec380 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:53.229131 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ad7f10e5-fbdb-4260-b2c8-1280dba3ef11 req-8987ccbf-4304-4614-8340-f9267c3ec380 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:53.241803 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-ad7f10e5-fbdb-4260-b2c8-1280dba3ef11 req-8987ccbf-4304-4614-8340-f9267c3ec380 service nova] Creating event network-changed:769a3c22-a257-4a0e-ab9e-27222b92bfb1 for instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 on hv-cinder-85083 Aug 29 19:04:53.247750 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-ad7f10e5-fbdb-4260-b2c8-1280dba3ef11 req-8987ccbf-4304-4614-8340-f9267c3ec380 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041003 Aug 29 19:04:53.248338 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 211/437] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:04:53.560382 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-154aa7ab-88d9-402a-9362-db816acf7670 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:53.561349 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-154aa7ab-88d9-402a-9362-db816acf7670 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:53.573066 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-154aa7ab-88d9-402a-9362-db816acf7670 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:53.573553 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-154aa7ab-88d9-402a-9362-db816acf7670 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:53.574222 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-154aa7ab-88d9-402a-9362-db816acf7670 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:53.575174 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-154aa7ab-88d9-402a-9362-db816acf7670 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:53.576346 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-154aa7ab-88d9-402a-9362-db816acf7670 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:53.576820 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-154aa7ab-88d9-402a-9362-db816acf7670 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:53.793271 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-154aa7ab-88d9-402a-9362-db816acf7670 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:53.802178 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-154aa7ab-88d9-402a-9362-db816acf7670 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.246672 Aug 29 19:04:53.802744 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 227/438] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:53 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:54.026544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3e9acb56-f45f-4d72-bf40-89def5ab3b16 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:54.027333 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3e9acb56-f45f-4d72-bf40-89def5ab3b16 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:54.034465 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e9acb56-f45f-4d72-bf40-89def5ab3b16 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:54.034960 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e9acb56-f45f-4d72-bf40-89def5ab3b16 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:54.035616 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e9acb56-f45f-4d72-bf40-89def5ab3b16 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:54.036501 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e9acb56-f45f-4d72-bf40-89def5ab3b16 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:54.037082 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e9acb56-f45f-4d72-bf40-89def5ab3b16 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:54.037381 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e9acb56-f45f-4d72-bf40-89def5ab3b16 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:54.190743 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3e9acb56-f45f-4d72-bf40-89def5ab3b16 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:54.199685 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3e9acb56-f45f-4d72-bf40-89def5ab3b16 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.177570 Aug 29 19:04:54.200350 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 212/439] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:54 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:54.824453 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a78662a2-6765-46aa-a011-76f240693c9e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:54.825092 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a78662a2-6765-46aa-a011-76f240693c9e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:54.827536 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:54.833609 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a78662a2-6765-46aa-a011-76f240693c9e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:54.834095 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a78662a2-6765-46aa-a011-76f240693c9e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:54.834666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a78662a2-6765-46aa-a011-76f240693c9e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:54.835540 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a78662a2-6765-46aa-a011-76f240693c9e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:54.835999 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a78662a2-6765-46aa-a011-76f240693c9e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:54.836424 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a78662a2-6765-46aa-a011-76f240693c9e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:54.974990 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a78662a2-6765-46aa-a011-76f240693c9e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:54.982940 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a78662a2-6765-46aa-a011-76f240693c9e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.162430 Aug 29 19:04:54.983798 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 228/440] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:54 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:55.220388 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-575597be-9a96-4f09-adcc-cc1f8b1473d4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:55.220962 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-575597be-9a96-4f09-adcc-cc1f8b1473d4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:55.227446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-575597be-9a96-4f09-adcc-cc1f8b1473d4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:55.227936 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-575597be-9a96-4f09-adcc-cc1f8b1473d4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:55.228370 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-575597be-9a96-4f09-adcc-cc1f8b1473d4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:55.229180 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-575597be-9a96-4f09-adcc-cc1f8b1473d4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:55.229631 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-575597be-9a96-4f09-adcc-cc1f8b1473d4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:55.230054 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-575597be-9a96-4f09-adcc-cc1f8b1473d4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:55.362328 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-575597be-9a96-4f09-adcc-cc1f8b1473d4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:55.369872 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-575597be-9a96-4f09-adcc-cc1f8b1473d4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.153479 Aug 29 19:04:55.370422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 213/441] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:55 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:56.005737 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0b06f685-b1e9-4c72-9cd2-823095539244 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:56.006268 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0b06f685-b1e9-4c72-9cd2-823095539244 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:56.012494 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0b06f685-b1e9-4c72-9cd2-823095539244 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:56.012969 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0b06f685-b1e9-4c72-9cd2-823095539244 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:56.013520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0b06f685-b1e9-4c72-9cd2-823095539244 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:56.014398 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0b06f685-b1e9-4c72-9cd2-823095539244 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:56.014859 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0b06f685-b1e9-4c72-9cd2-823095539244 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:56.015532 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0b06f685-b1e9-4c72-9cd2-823095539244 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:56.391120 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bd68d440-6477-4f53-8af2-192829615238 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:56.392059 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bd68d440-6477-4f53-8af2-192829615238 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:56.405064 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0b06f685-b1e9-4c72-9cd2-823095539244 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:56.406710 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bd68d440-6477-4f53-8af2-192829615238 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:56.407224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bd68d440-6477-4f53-8af2-192829615238 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:56.407655 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bd68d440-6477-4f53-8af2-192829615238 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:56.408355 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bd68d440-6477-4f53-8af2-192829615238 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:56.408800 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bd68d440-6477-4f53-8af2-192829615238 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:56.409231 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bd68d440-6477-4f53-8af2-192829615238 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:56.415057 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0b06f685-b1e9-4c72-9cd2-823095539244 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.413177 Aug 29 19:04:56.415735 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 229/442] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:56 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:56.433676 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:56.438559 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=12 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:56.518681 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-efa2a45f-587b-4167-82e7-fa057c46bb5e req-de5f94fc-430b-459f-9f63-a5443b859279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1134fbcb-be0a-424d-8e20-abf975209cb1", "name": "network-vif-plugged", "status": "completed", "tag": "71085a76-18e8-4947-99d8-a14d676237aa"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:04:56.529857 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-efa2a45f-587b-4167-82e7-fa057c46bb5e req-de5f94fc-430b-459f-9f63-a5443b859279 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:56.531205 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-efa2a45f-587b-4167-82e7-fa057c46bb5e req-de5f94fc-430b-459f-9f63-a5443b859279 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:56.531869 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-efa2a45f-587b-4167-82e7-fa057c46bb5e req-de5f94fc-430b-459f-9f63-a5443b859279 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:56.544760 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-efa2a45f-587b-4167-82e7-fa057c46bb5e req-de5f94fc-430b-459f-9f63-a5443b859279 service nova] Creating event network-vif-plugged:71085a76-18e8-4947-99d8-a14d676237aa for instance 1134fbcb-be0a-424d-8e20-abf975209cb1 on hv-cinder-85083 Aug 29 19:04:56.551952 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-efa2a45f-587b-4167-82e7-fa057c46bb5e req-de5f94fc-430b-459f-9f63-a5443b859279 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036902 Aug 29 19:04:56.552796 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 230/443] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:04:56.593372 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bd68d440-6477-4f53-8af2-192829615238 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:56.612768 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bd68d440-6477-4f53-8af2-192829615238 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.226256 Aug 29 19:04:56.613567 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 214/444] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:56 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:04:57.432483 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=8 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:57.436702 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1f60c811-128d-485a-89d2-5a80b9fae77a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:57.437396 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1f60c811-128d-485a-89d2-5a80b9fae77a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:57.444057 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f60c811-128d-485a-89d2-5a80b9fae77a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:57.444546 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f60c811-128d-485a-89d2-5a80b9fae77a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:57.444976 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f60c811-128d-485a-89d2-5a80b9fae77a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:57.445683 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f60c811-128d-485a-89d2-5a80b9fae77a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:57.446130 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f60c811-128d-485a-89d2-5a80b9fae77a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:57.446546 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f60c811-128d-485a-89d2-5a80b9fae77a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:57.582948 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1f60c811-128d-485a-89d2-5a80b9fae77a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:57.591519 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1f60c811-128d-485a-89d2-5a80b9fae77a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.159783 Aug 29 19:04:57.592089 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 231/445] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:57 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:57.633654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d780517a-e252-476b-b7ff-d074547795d3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:57.634258 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d780517a-e252-476b-b7ff-d074547795d3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:57.640763 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d780517a-e252-476b-b7ff-d074547795d3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:57.641226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d780517a-e252-476b-b7ff-d074547795d3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:57.641654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d780517a-e252-476b-b7ff-d074547795d3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:57.642331 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d780517a-e252-476b-b7ff-d074547795d3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:57.642775 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d780517a-e252-476b-b7ff-d074547795d3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:57.643227 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d780517a-e252-476b-b7ff-d074547795d3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:57.780962 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d780517a-e252-476b-b7ff-d074547795d3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:57.789566 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d780517a-e252-476b-b7ff-d074547795d3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.159718 Aug 29 19:04:57.790197 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 215/446] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:57 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:58.613289 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8d7c653e-ea1a-4c96-b91b-1d950eb2fc2d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:58.613861 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8d7c653e-ea1a-4c96-b91b-1d950eb2fc2d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:58.619944 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d7c653e-ea1a-4c96-b91b-1d950eb2fc2d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:58.620467 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d7c653e-ea1a-4c96-b91b-1d950eb2fc2d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:58.621163 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d7c653e-ea1a-4c96-b91b-1d950eb2fc2d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:58.621987 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d7c653e-ea1a-4c96-b91b-1d950eb2fc2d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:58.622786 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d7c653e-ea1a-4c96-b91b-1d950eb2fc2d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:58.623293 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d7c653e-ea1a-4c96-b91b-1d950eb2fc2d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:58.750809 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8d7c653e-ea1a-4c96-b91b-1d950eb2fc2d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:58.758322 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8d7c653e-ea1a-4c96-b91b-1d950eb2fc2d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.149055 Aug 29 19:04:58.758889 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 232/447] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:58 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:58.809639 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ca2e6618-6504-480d-a786-63b3b198136c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:58.810242 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ca2e6618-6504-480d-a786-63b3b198136c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:58.817048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca2e6618-6504-480d-a786-63b3b198136c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:58.817522 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca2e6618-6504-480d-a786-63b3b198136c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:58.817946 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca2e6618-6504-480d-a786-63b3b198136c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:58.818890 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca2e6618-6504-480d-a786-63b3b198136c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:58.819361 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca2e6618-6504-480d-a786-63b3b198136c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:58.819781 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca2e6618-6504-480d-a786-63b3b198136c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:58.946819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ca2e6618-6504-480d-a786-63b3b198136c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:58.954984 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ca2e6618-6504-480d-a786-63b3b198136c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.149077 Aug 29 19:04:58.955551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 216/448] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:58 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:59.779907 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b6b1859f-e709-47ad-8fcb-dccb9e01e93a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:59.780539 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b6b1859f-e709-47ad-8fcb-dccb9e01e93a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:59.786476 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6b1859f-e709-47ad-8fcb-dccb9e01e93a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:59.786957 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6b1859f-e709-47ad-8fcb-dccb9e01e93a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:59.787418 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6b1859f-e709-47ad-8fcb-dccb9e01e93a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:59.788097 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6b1859f-e709-47ad-8fcb-dccb9e01e93a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:59.788574 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6b1859f-e709-47ad-8fcb-dccb9e01e93a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:59.788990 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6b1859f-e709-47ad-8fcb-dccb9e01e93a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:59.917298 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b6b1859f-e709-47ad-8fcb-dccb9e01e93a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:04:59.924873 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b6b1859f-e709-47ad-8fcb-dccb9e01e93a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.148783 Aug 29 19:04:59.925445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 233/449] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:59 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:04:59.975419 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9d7250db-e2fd-4001-95f6-b91160745207 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:04:59.976072 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9d7250db-e2fd-4001-95f6-b91160745207 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:04:59.978361 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:59.983799 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9d7250db-e2fd-4001-95f6-b91160745207 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:59.984276 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9d7250db-e2fd-4001-95f6-b91160745207 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:59.984703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9d7250db-e2fd-4001-95f6-b91160745207 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:04:59.985379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9d7250db-e2fd-4001-95f6-b91160745207 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:04:59.985824 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9d7250db-e2fd-4001-95f6-b91160745207 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:04:59.986237 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9d7250db-e2fd-4001-95f6-b91160745207 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:00.131669 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9d7250db-e2fd-4001-95f6-b91160745207 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:00.139429 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9d7250db-e2fd-4001-95f6-b91160745207 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.167783 Aug 29 19:05:00.140501 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 217/450] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:04:59 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:00.945697 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8148f836-61a9-4b96-995c-c70d382a9643 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:00.946426 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8148f836-61a9-4b96-995c-c70d382a9643 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:00.952405 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8148f836-61a9-4b96-995c-c70d382a9643 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:00.952893 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8148f836-61a9-4b96-995c-c70d382a9643 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:00.953327 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8148f836-61a9-4b96-995c-c70d382a9643 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:00.954149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8148f836-61a9-4b96-995c-c70d382a9643 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:00.954602 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8148f836-61a9-4b96-995c-c70d382a9643 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:00.955065 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8148f836-61a9-4b96-995c-c70d382a9643 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:01.090867 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8148f836-61a9-4b96-995c-c70d382a9643 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:01.099224 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8148f836-61a9-4b96-995c-c70d382a9643 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.157573 Aug 29 19:05:01.099794 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 234/451] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:00 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:01.161476 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1f205283-7a0f-4316-bcff-5ae875347dc6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:01.162087 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1f205283-7a0f-4316-bcff-5ae875347dc6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:01.168613 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f205283-7a0f-4316-bcff-5ae875347dc6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:01.169096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f205283-7a0f-4316-bcff-5ae875347dc6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:01.169530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f205283-7a0f-4316-bcff-5ae875347dc6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:01.170218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f205283-7a0f-4316-bcff-5ae875347dc6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:01.170672 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f205283-7a0f-4316-bcff-5ae875347dc6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:01.171838 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f205283-7a0f-4316-bcff-5ae875347dc6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:01.305363 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1f205283-7a0f-4316-bcff-5ae875347dc6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:01.312984 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1f205283-7a0f-4316-bcff-5ae875347dc6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.155696 Aug 29 19:05:01.313544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 218/452] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:01 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:02.121569 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-71f6e68f-8475-4d19-bc89-d56e3376bd2b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:02.122185 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-71f6e68f-8475-4d19-bc89-d56e3376bd2b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:02.128256 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71f6e68f-8475-4d19-bc89-d56e3376bd2b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:02.128866 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71f6e68f-8475-4d19-bc89-d56e3376bd2b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:02.129221 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71f6e68f-8475-4d19-bc89-d56e3376bd2b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:02.129993 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71f6e68f-8475-4d19-bc89-d56e3376bd2b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:02.130403 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71f6e68f-8475-4d19-bc89-d56e3376bd2b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:02.130905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71f6e68f-8475-4d19-bc89-d56e3376bd2b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:02.267094 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-71f6e68f-8475-4d19-bc89-d56e3376bd2b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:02.274597 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-71f6e68f-8475-4d19-bc89-d56e3376bd2b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.157459 Aug 29 19:05:02.275182 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 235/453] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:02 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:02.334016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-14ac1791-c923-458b-87d2-dfefdaf2cac0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:02.334652 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-14ac1791-c923-458b-87d2-dfefdaf2cac0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:02.341998 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14ac1791-c923-458b-87d2-dfefdaf2cac0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:02.342488 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14ac1791-c923-458b-87d2-dfefdaf2cac0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:02.343968 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14ac1791-c923-458b-87d2-dfefdaf2cac0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:02.344739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14ac1791-c923-458b-87d2-dfefdaf2cac0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:02.345216 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14ac1791-c923-458b-87d2-dfefdaf2cac0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:02.345695 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14ac1791-c923-458b-87d2-dfefdaf2cac0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:02.481417 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-14ac1791-c923-458b-87d2-dfefdaf2cac0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:02.489833 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-14ac1791-c923-458b-87d2-dfefdaf2cac0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.159724 Aug 29 19:05:02.490783 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 219/454] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:02 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:03.295278 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7ad3e2eb-85fd-4f99-847a-13722c1582ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:03.295986 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7ad3e2eb-85fd-4f99-847a-13722c1582ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:03.302574 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ad3e2eb-85fd-4f99-847a-13722c1582ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:03.303100 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ad3e2eb-85fd-4f99-847a-13722c1582ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:03.303551 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ad3e2eb-85fd-4f99-847a-13722c1582ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:03.304233 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ad3e2eb-85fd-4f99-847a-13722c1582ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:03.304688 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ad3e2eb-85fd-4f99-847a-13722c1582ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:03.305106 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ad3e2eb-85fd-4f99-847a-13722c1582ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:03.440126 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7ad3e2eb-85fd-4f99-847a-13722c1582ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:03.448065 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7ad3e2eb-85fd-4f99-847a-13722c1582ff tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.156725 Aug 29 19:05:03.448768 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 236/455] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:03 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:03.511348 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-57b0d14b-76d3-41c6-882b-c1dba12c0c55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:03.512366 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-57b0d14b-76d3-41c6-882b-c1dba12c0c55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:03.519556 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57b0d14b-76d3-41c6-882b-c1dba12c0c55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:03.520033 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57b0d14b-76d3-41c6-882b-c1dba12c0c55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:03.520457 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57b0d14b-76d3-41c6-882b-c1dba12c0c55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:03.521140 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57b0d14b-76d3-41c6-882b-c1dba12c0c55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:03.521582 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57b0d14b-76d3-41c6-882b-c1dba12c0c55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:03.522112 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57b0d14b-76d3-41c6-882b-c1dba12c0c55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:03.652734 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-57b0d14b-76d3-41c6-882b-c1dba12c0c55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:03.660884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-57b0d14b-76d3-41c6-882b-c1dba12c0c55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.153491 Aug 29 19:05:03.661444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 220/456] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:03 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:04.469797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-99dd1471-a301-4711-99b7-0ab6749d6cac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:04.470408 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-99dd1471-a301-4711-99b7-0ab6749d6cac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:04.476460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99dd1471-a301-4711-99b7-0ab6749d6cac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:04.476942 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99dd1471-a301-4711-99b7-0ab6749d6cac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:04.477376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99dd1471-a301-4711-99b7-0ab6749d6cac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:04.478270 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99dd1471-a301-4711-99b7-0ab6749d6cac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:04.478934 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99dd1471-a301-4711-99b7-0ab6749d6cac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:04.479475 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99dd1471-a301-4711-99b7-0ab6749d6cac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:04.682944 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5c307b68-f04c-451c-8310-f569310669a5 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:04.684355 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5c307b68-f04c-451c-8310-f569310669a5 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:04.690147 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-99dd1471-a301-4711-99b7-0ab6749d6cac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:04.703759 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c307b68-f04c-451c-8310-f569310669a5 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:04.704247 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c307b68-f04c-451c-8310-f569310669a5 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:04.706430 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c307b68-f04c-451c-8310-f569310669a5 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:04.707196 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c307b68-f04c-451c-8310-f569310669a5 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:04.707658 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c307b68-f04c-451c-8310-f569310669a5 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:04.708113 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c307b68-f04c-451c-8310-f569310669a5 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:04.718306 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-99dd1471-a301-4711-99b7-0ab6749d6cac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.252455 Aug 29 19:05:04.723652 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 237/457] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:04 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:04.950573 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5c307b68-f04c-451c-8310-f569310669a5 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:04.959367 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5c307b68-f04c-451c-8310-f569310669a5 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.280539 Aug 29 19:05:04.962363 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 221/458] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:04 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:05.750594 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9284a7f5-d652-452d-8973-e50bbb5c085e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:05.751235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9284a7f5-d652-452d-8973-e50bbb5c085e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:05.757287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9284a7f5-d652-452d-8973-e50bbb5c085e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:05.757772 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9284a7f5-d652-452d-8973-e50bbb5c085e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:05.758209 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9284a7f5-d652-452d-8973-e50bbb5c085e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:05.758921 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9284a7f5-d652-452d-8973-e50bbb5c085e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:05.759403 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9284a7f5-d652-452d-8973-e50bbb5c085e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:05.759826 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9284a7f5-d652-452d-8973-e50bbb5c085e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:05.904960 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9284a7f5-d652-452d-8973-e50bbb5c085e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:05.912665 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9284a7f5-d652-452d-8973-e50bbb5c085e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.166442 Aug 29 19:05:05.913234 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 238/459] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:05 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:05:05.980097 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-26c832de-60e5-4682-b9bb-4b12583f79c3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:05.980708 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-26c832de-60e5-4682-b9bb-4b12583f79c3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:05.987745 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-26c832de-60e5-4682-b9bb-4b12583f79c3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:05.988279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-26c832de-60e5-4682-b9bb-4b12583f79c3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:05.988709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-26c832de-60e5-4682-b9bb-4b12583f79c3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:05.989387 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-26c832de-60e5-4682-b9bb-4b12583f79c3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:05.989834 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-26c832de-60e5-4682-b9bb-4b12583f79c3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:05.990251 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-26c832de-60e5-4682-b9bb-4b12583f79c3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:06.119980 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-26c832de-60e5-4682-b9bb-4b12583f79c3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:06.128252 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-26c832de-60e5-4682-b9bb-4b12583f79c3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.152041 Aug 29 19:05:06.128815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 222/460] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:05 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:06.933561 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2fb8be3b-a8fa-4a5c-bcbb-89105284cd50 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:06.934163 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2fb8be3b-a8fa-4a5c-bcbb-89105284cd50 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:06.940769 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2fb8be3b-a8fa-4a5c-bcbb-89105284cd50 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:06.941198 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2fb8be3b-a8fa-4a5c-bcbb-89105284cd50 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:06.941630 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2fb8be3b-a8fa-4a5c-bcbb-89105284cd50 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:06.942313 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2fb8be3b-a8fa-4a5c-bcbb-89105284cd50 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:06.942760 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2fb8be3b-a8fa-4a5c-bcbb-89105284cd50 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:06.943213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2fb8be3b-a8fa-4a5c-bcbb-89105284cd50 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:07.072436 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2fb8be3b-a8fa-4a5c-bcbb-89105284cd50 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:07.080012 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2fb8be3b-a8fa-4a5c-bcbb-89105284cd50 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.150311 Aug 29 19:05:07.080568 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 239/461] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:06 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:07.149072 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-441d05ff-8fc9-436c-b148-a69f4c659c59 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:07.149715 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-441d05ff-8fc9-436c-b148-a69f4c659c59 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:07.156752 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-441d05ff-8fc9-436c-b148-a69f4c659c59 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:07.157226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-441d05ff-8fc9-436c-b148-a69f4c659c59 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:07.157657 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-441d05ff-8fc9-436c-b148-a69f4c659c59 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:07.158333 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-441d05ff-8fc9-436c-b148-a69f4c659c59 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:07.158781 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-441d05ff-8fc9-436c-b148-a69f4c659c59 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:07.159236 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-441d05ff-8fc9-436c-b148-a69f4c659c59 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:07.163169 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:05:07.286538 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-441d05ff-8fc9-436c-b148-a69f4c659c59 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:07.294168 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-441d05ff-8fc9-436c-b148-a69f4c659c59 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.148971 Aug 29 19:05:07.294731 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 223/462] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:07 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:08.101291 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8218b50e-d8ce-4974-9a9a-10070f339b83 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:08.101923 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8218b50e-d8ce-4974-9a9a-10070f339b83 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:08.107873 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8218b50e-d8ce-4974-9a9a-10070f339b83 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:08.108395 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8218b50e-d8ce-4974-9a9a-10070f339b83 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:08.109628 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8218b50e-d8ce-4974-9a9a-10070f339b83 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:08.110232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8218b50e-d8ce-4974-9a9a-10070f339b83 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:08.110676 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8218b50e-d8ce-4974-9a9a-10070f339b83 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:08.111119 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8218b50e-d8ce-4974-9a9a-10070f339b83 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:08.242737 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8218b50e-d8ce-4974-9a9a-10070f339b83 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:08.250303 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8218b50e-d8ce-4974-9a9a-10070f339b83 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.152948 Aug 29 19:05:08.250864 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 240/463] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:08 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:08.315689 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-af2a5356-a403-4ba1-95bb-b6baccc8a7e3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:08.316348 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-af2a5356-a403-4ba1-95bb-b6baccc8a7e3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:08.322932 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af2a5356-a403-4ba1-95bb-b6baccc8a7e3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:08.323440 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af2a5356-a403-4ba1-95bb-b6baccc8a7e3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:08.323873 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af2a5356-a403-4ba1-95bb-b6baccc8a7e3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:08.324549 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af2a5356-a403-4ba1-95bb-b6baccc8a7e3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:08.325013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af2a5356-a403-4ba1-95bb-b6baccc8a7e3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:08.325419 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af2a5356-a403-4ba1-95bb-b6baccc8a7e3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:08.457244 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-af2a5356-a403-4ba1-95bb-b6baccc8a7e3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:08.464897 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-af2a5356-a403-4ba1-95bb-b6baccc8a7e3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.153699 Aug 29 19:05:08.465456 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 224/464] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:08 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:09.269429 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0de4a757-eb2d-4326-a64c-3160b55d1f98 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:09.270059 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0de4a757-eb2d-4326-a64c-3160b55d1f98 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:09.276021 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0de4a757-eb2d-4326-a64c-3160b55d1f98 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:09.276643 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0de4a757-eb2d-4326-a64c-3160b55d1f98 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:09.277074 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0de4a757-eb2d-4326-a64c-3160b55d1f98 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:09.277758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0de4a757-eb2d-4326-a64c-3160b55d1f98 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:09.278216 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0de4a757-eb2d-4326-a64c-3160b55d1f98 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:09.278639 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0de4a757-eb2d-4326-a64c-3160b55d1f98 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:09.404829 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0de4a757-eb2d-4326-a64c-3160b55d1f98 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:09.412928 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0de4a757-eb2d-4326-a64c-3160b55d1f98 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.147279 Aug 29 19:05:09.413488 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 241/465] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:09 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:09.486177 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-16df5459-5aff-4834-8bfa-681b08ed62e8 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:09.486758 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-16df5459-5aff-4834-8bfa-681b08ed62e8 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:09.493375 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-16df5459-5aff-4834-8bfa-681b08ed62e8 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:09.493854 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-16df5459-5aff-4834-8bfa-681b08ed62e8 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:09.494286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-16df5459-5aff-4834-8bfa-681b08ed62e8 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:09.494969 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-16df5459-5aff-4834-8bfa-681b08ed62e8 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:09.495446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-16df5459-5aff-4834-8bfa-681b08ed62e8 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:09.495866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-16df5459-5aff-4834-8bfa-681b08ed62e8 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:09.626525 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-16df5459-5aff-4834-8bfa-681b08ed62e8 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:09.634278 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-16df5459-5aff-4834-8bfa-681b08ed62e8 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.152574 Aug 29 19:05:09.634833 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 225/466] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:09 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:10.434373 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1cf1e351-dba1-4690-ab6b-24e052189a79 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:10.434975 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1cf1e351-dba1-4690-ab6b-24e052189a79 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:10.441566 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cf1e351-dba1-4690-ab6b-24e052189a79 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:10.442050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cf1e351-dba1-4690-ab6b-24e052189a79 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:10.442485 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cf1e351-dba1-4690-ab6b-24e052189a79 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:10.443203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cf1e351-dba1-4690-ab6b-24e052189a79 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:10.443901 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cf1e351-dba1-4690-ab6b-24e052189a79 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:10.444331 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cf1e351-dba1-4690-ab6b-24e052189a79 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:10.575021 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1cf1e351-dba1-4690-ab6b-24e052189a79 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:10.584303 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1cf1e351-dba1-4690-ab6b-24e052189a79 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.153764 Aug 29 19:05:10.584869 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 242/467] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:10 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:10.656628 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-89933899-18ba-4a2c-9cc8-c20d5ceb716c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:10.657244 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-89933899-18ba-4a2c-9cc8-c20d5ceb716c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:10.663796 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-89933899-18ba-4a2c-9cc8-c20d5ceb716c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:10.664284 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-89933899-18ba-4a2c-9cc8-c20d5ceb716c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:10.664719 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-89933899-18ba-4a2c-9cc8-c20d5ceb716c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:10.665410 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-89933899-18ba-4a2c-9cc8-c20d5ceb716c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:10.665866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-89933899-18ba-4a2c-9cc8-c20d5ceb716c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:10.666289 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-89933899-18ba-4a2c-9cc8-c20d5ceb716c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:10.794457 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-89933899-18ba-4a2c-9cc8-c20d5ceb716c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:10.802076 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-89933899-18ba-4a2c-9cc8-c20d5ceb716c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.149333 Aug 29 19:05:10.802636 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 226/468] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:10 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:11.605869 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c16cff33-4c7a-465a-a6f2-ad96fe463070 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:11.606588 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c16cff33-4c7a-465a-a6f2-ad96fe463070 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:11.608482 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:05:11.614357 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c16cff33-4c7a-465a-a6f2-ad96fe463070 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:11.614839 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c16cff33-4c7a-465a-a6f2-ad96fe463070 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:11.615286 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c16cff33-4c7a-465a-a6f2-ad96fe463070 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:11.615973 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c16cff33-4c7a-465a-a6f2-ad96fe463070 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:11.616416 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c16cff33-4c7a-465a-a6f2-ad96fe463070 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:11.616831 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c16cff33-4c7a-465a-a6f2-ad96fe463070 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:11.756078 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c16cff33-4c7a-465a-a6f2-ad96fe463070 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:11.758232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:05:11.765432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c16cff33-4c7a-465a-a6f2-ad96fe463070 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.164201 Aug 29 19:05:11.766829 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 243/469] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:11 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:11.799660 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-d009f0f2-d841-465f-bc8a-e69b2439ac78 req-d4140325-d489-47a9-86d6-46185d47990a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb25d6a-e6bb-4fb7-917c-07041d4509a3", "name": "network-vif-plugged", "status": "completed", "tag": "769a3c22-a257-4a0e-ab9e-27222b92bfb1"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:05:11.810225 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-d009f0f2-d841-465f-bc8a-e69b2439ac78 req-d4140325-d489-47a9-86d6-46185d47990a service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:11.810883 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-d009f0f2-d841-465f-bc8a-e69b2439ac78 req-d4140325-d489-47a9-86d6-46185d47990a service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:11.811408 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-d009f0f2-d841-465f-bc8a-e69b2439ac78 req-d4140325-d489-47a9-86d6-46185d47990a service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:11.823688 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-d009f0f2-d841-465f-bc8a-e69b2439ac78 req-d4140325-d489-47a9-86d6-46185d47990a service nova] Creating event network-vif-plugged:769a3c22-a257-4a0e-ab9e-27222b92bfb1 for instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 on hv-cinder-85083 Aug 29 19:05:11.824345 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ce153fcc-f97b-4452-aaee-f2b46e969d73 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:11.825024 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ce153fcc-f97b-4452-aaee-f2b46e969d73 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:11.830006 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-d009f0f2-d841-465f-bc8a-e69b2439ac78 req-d4140325-d489-47a9-86d6-46185d47990a service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032825 Aug 29 19:05:11.831185 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 227/470] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:05:11.833156 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ce153fcc-f97b-4452-aaee-f2b46e969d73 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:11.833674 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ce153fcc-f97b-4452-aaee-f2b46e969d73 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:11.834123 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ce153fcc-f97b-4452-aaee-f2b46e969d73 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:11.834822 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ce153fcc-f97b-4452-aaee-f2b46e969d73 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:11.835303 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ce153fcc-f97b-4452-aaee-f2b46e969d73 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:11.835727 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ce153fcc-f97b-4452-aaee-f2b46e969d73 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:11.975327 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ce153fcc-f97b-4452-aaee-f2b46e969d73 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:11.983412 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ce153fcc-f97b-4452-aaee-f2b46e969d73 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1318 microversion: 2.1 time: 0.163765 Aug 29 19:05:11.983991 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 244/471] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:11 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:05:12.787785 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-08ba065e-1ed4-404f-af05-e8fff96e8ee9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:12.788475 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-08ba065e-1ed4-404f-af05-e8fff96e8ee9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:12.794456 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-08ba065e-1ed4-404f-af05-e8fff96e8ee9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:12.794938 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-08ba065e-1ed4-404f-af05-e8fff96e8ee9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:12.795471 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-08ba065e-1ed4-404f-af05-e8fff96e8ee9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:12.796145 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-08ba065e-1ed4-404f-af05-e8fff96e8ee9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:12.796592 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-08ba065e-1ed4-404f-af05-e8fff96e8ee9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:12.797012 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-08ba065e-1ed4-404f-af05-e8fff96e8ee9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:12.926980 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-08ba065e-1ed4-404f-af05-e8fff96e8ee9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:12.934503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-08ba065e-1ed4-404f-af05-e8fff96e8ee9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.150954 Aug 29 19:05:12.935273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 228/472] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:12 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:13.004377 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-11228ec9-6e06-4a00-bf97-14a9370689f1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:13.004998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-11228ec9-6e06-4a00-bf97-14a9370689f1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:13.011030 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11228ec9-6e06-4a00-bf97-14a9370689f1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:13.011524 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11228ec9-6e06-4a00-bf97-14a9370689f1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:13.011961 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11228ec9-6e06-4a00-bf97-14a9370689f1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:13.012652 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11228ec9-6e06-4a00-bf97-14a9370689f1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:13.013108 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11228ec9-6e06-4a00-bf97-14a9370689f1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:13.013535 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11228ec9-6e06-4a00-bf97-14a9370689f1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:13.139744 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-11228ec9-6e06-4a00-bf97-14a9370689f1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:13.150160 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-11228ec9-6e06-4a00-bf97-14a9370689f1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1507 microversion: 2.1 time: 0.149879 Aug 29 19:05:13.150927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 245/473] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:12 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:05:13.955270 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c1a197c3-b6bd-4afa-a2ec-80354e39ae1b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:13.955873 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c1a197c3-b6bd-4afa-a2ec-80354e39ae1b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:13.962277 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1a197c3-b6bd-4afa-a2ec-80354e39ae1b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:13.962753 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1a197c3-b6bd-4afa-a2ec-80354e39ae1b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:13.963225 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1a197c3-b6bd-4afa-a2ec-80354e39ae1b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:13.963911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1a197c3-b6bd-4afa-a2ec-80354e39ae1b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:13.964359 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1a197c3-b6bd-4afa-a2ec-80354e39ae1b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:13.964777 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1a197c3-b6bd-4afa-a2ec-80354e39ae1b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:14.092431 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c1a197c3-b6bd-4afa-a2ec-80354e39ae1b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:14.100678 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c1a197c3-b6bd-4afa-a2ec-80354e39ae1b tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.149323 Aug 29 19:05:14.101237 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 229/474] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:13 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:15.121648 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-32af8f4c-bfe0-46f0-b11f-384c6a068d6f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:15.122192 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-32af8f4c-bfe0-46f0-b11f-384c6a068d6f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:15.128977 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32af8f4c-bfe0-46f0-b11f-384c6a068d6f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:15.129460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32af8f4c-bfe0-46f0-b11f-384c6a068d6f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:15.129898 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32af8f4c-bfe0-46f0-b11f-384c6a068d6f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:15.130586 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32af8f4c-bfe0-46f0-b11f-384c6a068d6f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:15.131139 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32af8f4c-bfe0-46f0-b11f-384c6a068d6f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:15.131565 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32af8f4c-bfe0-46f0-b11f-384c6a068d6f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:15.261526 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-32af8f4c-bfe0-46f0-b11f-384c6a068d6f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:15.269000 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-32af8f4c-bfe0-46f0-b11f-384c6a068d6f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.151731 Aug 29 19:05:15.269564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 246/475] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:15 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:16.290044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-36dcb448-04b1-47fd-9a82-db8391a9bc67 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:16.290658 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-36dcb448-04b1-47fd-9a82-db8391a9bc67 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:16.297302 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36dcb448-04b1-47fd-9a82-db8391a9bc67 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:16.297790 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36dcb448-04b1-47fd-9a82-db8391a9bc67 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:16.298223 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36dcb448-04b1-47fd-9a82-db8391a9bc67 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:16.298915 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36dcb448-04b1-47fd-9a82-db8391a9bc67 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:16.299394 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36dcb448-04b1-47fd-9a82-db8391a9bc67 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:16.299819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36dcb448-04b1-47fd-9a82-db8391a9bc67 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:16.425899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-36dcb448-04b1-47fd-9a82-db8391a9bc67 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:16.433377 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-36dcb448-04b1-47fd-9a82-db8391a9bc67 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.147259 Aug 29 19:05:16.433929 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 230/476] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:16 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:05:17.463843 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-db6655e7-00d5-43bb-8968-80ef87f32f17 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:17.464220 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-db6655e7-00d5-43bb-8968-80ef87f32f17 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:17.471247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db6655e7-00d5-43bb-8968-80ef87f32f17 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:17.471734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db6655e7-00d5-43bb-8968-80ef87f32f17 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:17.472167 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db6655e7-00d5-43bb-8968-80ef87f32f17 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:17.472866 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db6655e7-00d5-43bb-8968-80ef87f32f17 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:17.473352 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db6655e7-00d5-43bb-8968-80ef87f32f17 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:17.473774 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db6655e7-00d5-43bb-8968-80ef87f32f17 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:17.606553 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-db6655e7-00d5-43bb-8968-80ef87f32f17 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:17.614473 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-db6655e7-00d5-43bb-8968-80ef87f32f17 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.163693 Aug 29 19:05:17.615057 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 247/477] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:17 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:18.635494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e5124a81-33ef-45eb-99b6-ed940a598e45 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:18.636114 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e5124a81-33ef-45eb-99b6-ed940a598e45 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:18.642967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5124a81-33ef-45eb-99b6-ed940a598e45 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:18.643491 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5124a81-33ef-45eb-99b6-ed940a598e45 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:18.643933 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5124a81-33ef-45eb-99b6-ed940a598e45 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:18.644627 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5124a81-33ef-45eb-99b6-ed940a598e45 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:18.645081 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5124a81-33ef-45eb-99b6-ed940a598e45 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:18.645506 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5124a81-33ef-45eb-99b6-ed940a598e45 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:18.771403 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e5124a81-33ef-45eb-99b6-ed940a598e45 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:18.779160 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e5124a81-33ef-45eb-99b6-ed940a598e45 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.147504 Aug 29 19:05:18.779728 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 231/478] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:18 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:19.801287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-39624089-f46e-4551-b735-a8b7ff41634e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:19.801890 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-39624089-f46e-4551-b735-a8b7ff41634e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:19.807879 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-39624089-f46e-4551-b735-a8b7ff41634e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:19.808356 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-39624089-f46e-4551-b735-a8b7ff41634e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:19.808783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-39624089-f46e-4551-b735-a8b7ff41634e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:19.809457 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-39624089-f46e-4551-b735-a8b7ff41634e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:19.809901 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-39624089-f46e-4551-b735-a8b7ff41634e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:19.810314 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-39624089-f46e-4551-b735-a8b7ff41634e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:19.964183 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-39624089-f46e-4551-b735-a8b7ff41634e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:19.972734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-39624089-f46e-4551-b735-a8b7ff41634e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.176786 Aug 29 19:05:19.973305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 248/479] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:19 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:20.994596 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c702e3c4-a0d9-4fe9-902a-2f9e37703955 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:20.995176 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c702e3c4-a0d9-4fe9-902a-2f9e37703955 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:21.002550 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c702e3c4-a0d9-4fe9-902a-2f9e37703955 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:21.003054 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c702e3c4-a0d9-4fe9-902a-2f9e37703955 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:21.003490 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c702e3c4-a0d9-4fe9-902a-2f9e37703955 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:21.004173 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c702e3c4-a0d9-4fe9-902a-2f9e37703955 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:21.004624 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c702e3c4-a0d9-4fe9-902a-2f9e37703955 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:21.005046 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c702e3c4-a0d9-4fe9-902a-2f9e37703955 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:21.130894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c702e3c4-a0d9-4fe9-902a-2f9e37703955 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:21.141624 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c702e3c4-a0d9-4fe9-902a-2f9e37703955 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.150806 Aug 29 19:05:21.142464 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 232/480] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:20 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:22.161832 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fc2c2ae3-47ee-45fe-b03f-b2bcbd91811a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:22.162455 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fc2c2ae3-47ee-45fe-b03f-b2bcbd91811a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:22.176505 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc2c2ae3-47ee-45fe-b03f-b2bcbd91811a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:22.177068 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc2c2ae3-47ee-45fe-b03f-b2bcbd91811a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:22.177622 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc2c2ae3-47ee-45fe-b03f-b2bcbd91811a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:22.178351 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc2c2ae3-47ee-45fe-b03f-b2bcbd91811a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:22.178802 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc2c2ae3-47ee-45fe-b03f-b2bcbd91811a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:22.179245 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc2c2ae3-47ee-45fe-b03f-b2bcbd91811a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:22.327229 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fc2c2ae3-47ee-45fe-b03f-b2bcbd91811a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:22.335924 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fc2c2ae3-47ee-45fe-b03f-b2bcbd91811a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.178063 Aug 29 19:05:22.336490 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 249/481] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:22 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:23.355958 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9b9ef49c-2927-42bd-913e-a05e0395d1eb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:23.356558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9b9ef49c-2927-42bd-913e-a05e0395d1eb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:23.363997 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b9ef49c-2927-42bd-913e-a05e0395d1eb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:23.364699 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b9ef49c-2927-42bd-913e-a05e0395d1eb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:23.365190 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b9ef49c-2927-42bd-913e-a05e0395d1eb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:23.365907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b9ef49c-2927-42bd-913e-a05e0395d1eb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:23.366493 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b9ef49c-2927-42bd-913e-a05e0395d1eb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:23.366919 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b9ef49c-2927-42bd-913e-a05e0395d1eb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:23.502451 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9b9ef49c-2927-42bd-913e-a05e0395d1eb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:23.510087 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9b9ef49c-2927-42bd-913e-a05e0395d1eb tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1371 microversion: 2.1 time: 0.158041 Aug 29 19:05:23.510651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 233/482] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:23 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:24.530743 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-438f12d9-1923-47e1-bcec-1dcdc1a94098 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:24.531571 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-438f12d9-1923-47e1-bcec-1dcdc1a94098 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:24.537677 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-438f12d9-1923-47e1-bcec-1dcdc1a94098 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:24.538169 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-438f12d9-1923-47e1-bcec-1dcdc1a94098 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:24.538601 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-438f12d9-1923-47e1-bcec-1dcdc1a94098 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:24.539469 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-438f12d9-1923-47e1-bcec-1dcdc1a94098 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:24.539921 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-438f12d9-1923-47e1-bcec-1dcdc1a94098 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:24.540346 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-438f12d9-1923-47e1-bcec-1dcdc1a94098 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:24.672899 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-438f12d9-1923-47e1-bcec-1dcdc1a94098 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:24.680899 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-438f12d9-1923-47e1-bcec-1dcdc1a94098 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1565 microversion: 2.1 time: 0.154098 Aug 29 19:05:24.681549 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 250/483] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:24 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:05:24.702750 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-65e4205d-7aa3-4b11-b05d-326805b6e873 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:24.703347 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-65e4205d-7aa3-4b11-b05d-326805b6e873 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:24.712301 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-65e4205d-7aa3-4b11-b05d-326805b6e873 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:24.712782 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-65e4205d-7aa3-4b11-b05d-326805b6e873 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:24.713213 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-65e4205d-7aa3-4b11-b05d-326805b6e873 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:24.713903 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-65e4205d-7aa3-4b11-b05d-326805b6e873 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:24.714355 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-65e4205d-7aa3-4b11-b05d-326805b6e873 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:24.714775 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-65e4205d-7aa3-4b11-b05d-326805b6e873 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:24.794491 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-65e4205d-7aa3-4b11-b05d-326805b6e873 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095888 Aug 29 19:05:24.795102 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 234/484] 10.222.0.86 () {58 vars in 1275 bytes} [Mon Aug 29 19:05:24 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:05:25.458963 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-675f7f06-d73d-4eb9-a707-3b5eb316dbeb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:25.459945 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-675f7f06-d73d-4eb9-a707-3b5eb316dbeb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:25.466730 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-675f7f06-d73d-4eb9-a707-3b5eb316dbeb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:25.467666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-675f7f06-d73d-4eb9-a707-3b5eb316dbeb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:25.468360 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-675f7f06-d73d-4eb9-a707-3b5eb316dbeb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:25.469946 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-675f7f06-d73d-4eb9-a707-3b5eb316dbeb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:25.470704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-675f7f06-d73d-4eb9-a707-3b5eb316dbeb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:25.471364 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-675f7f06-d73d-4eb9-a707-3b5eb316dbeb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:25.497616 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-675f7f06-d73d-4eb9-a707-3b5eb316dbeb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/ips" status: 200 len: 144 microversion: 2.1 time: 0.042877 Aug 29 19:05:25.498513 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 251/485] 10.222.0.86 () {58 vars in 1248 bytes} [Mon Aug 29 19:05:25 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/ips => generated 144 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:05:25.788680 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-636386f5-5908-4f40-bf69-af69097b426d req-bfc42662-5741-40bf-8dff-035905a3f7fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb25d6a-e6bb-4fb7-917c-07041d4509a3", "tag": "769a3c22-a257-4a0e-ab9e-27222b92bfb1"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:05:25.798332 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-636386f5-5908-4f40-bf69-af69097b426d req-bfc42662-5741-40bf-8dff-035905a3f7fd service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:25.798814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-636386f5-5908-4f40-bf69-af69097b426d req-bfc42662-5741-40bf-8dff-035905a3f7fd service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:25.799282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-636386f5-5908-4f40-bf69-af69097b426d req-bfc42662-5741-40bf-8dff-035905a3f7fd service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:25.811302 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-636386f5-5908-4f40-bf69-af69097b426d req-bfc42662-5741-40bf-8dff-035905a3f7fd service nova] Creating event network-changed:769a3c22-a257-4a0e-ab9e-27222b92bfb1 for instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 on hv-cinder-85083 Aug 29 19:05:25.817401 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-636386f5-5908-4f40-bf69-af69097b426d req-bfc42662-5741-40bf-8dff-035905a3f7fd service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032714 Aug 29 19:05:25.818368 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 235/486] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:05:29.996647 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2d7e6719-6455-41ba-b8f2-6f9c6534143d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fe39ad5-31c5-4d08-81fa-bab443971a3e"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:05:29.998963 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2d7e6719-6455-41ba-b8f2-6f9c6534143d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:30.005022 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d7e6719-6455-41ba-b8f2-6f9c6534143d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:30.005505 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d7e6719-6455-41ba-b8f2-6f9c6534143d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:30.005941 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d7e6719-6455-41ba-b8f2-6f9c6534143d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:30.006626 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d7e6719-6455-41ba-b8f2-6f9c6534143d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:30.007116 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d7e6719-6455-41ba-b8f2-6f9c6534143d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:30.007548 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d7e6719-6455-41ba-b8f2-6f9c6534143d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:30.479803 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2d7e6719-6455-41ba-b8f2-6f9c6534143d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "POST /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.486888 Aug 29 19:05:30.480496 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 252/487] 10.222.0.86 () {60 vars in 1323 bytes} [Mon Aug 29 19:05:29 2022] POST /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/os-volume_attachments => generated 194 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:05:58.256940 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=37 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:05:58.257678 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=66 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:05:58.262547 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0a085e09-c271-478d-98b9-a6e2cb124745 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:05:58.270188 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0a085e09-c271-478d-98b9-a6e2cb124745 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:58.270671 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0a085e09-c271-478d-98b9-a6e2cb124745 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:58.271140 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0a085e09-c271-478d-98b9-a6e2cb124745 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:58.332638 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0a085e09-c271-478d-98b9-a6e2cb124745 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Going to try to stop instance {{(pid=120708) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 19:05:58.383627 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0a085e09-c271-478d-98b9-a6e2cb124745 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "POST /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/action" status: 202 len: 0 microversion: 2.1 time: 0.128007 Aug 29 19:05:58.384218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 236/488] 10.222.0.86 () {60 vars in 1278 bytes} [Mon Aug 29 19:05:58 2022] POST /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:05:58.393156 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=19 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:05:58.397320 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:05:58.404652 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-870988ec-b170-4f31-b063-a604b93671d5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:58.405500 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-870988ec-b170-4f31-b063-a604b93671d5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:58.414714 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-870988ec-b170-4f31-b063-a604b93671d5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:58.415533 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-870988ec-b170-4f31-b063-a604b93671d5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:58.415952 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-870988ec-b170-4f31-b063-a604b93671d5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:58.416645 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-870988ec-b170-4f31-b063-a604b93671d5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:58.417096 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-870988ec-b170-4f31-b063-a604b93671d5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:58.417511 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-870988ec-b170-4f31-b063-a604b93671d5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:58.551938 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-870988ec-b170-4f31-b063-a604b93671d5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:58.560082 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-870988ec-b170-4f31-b063-a604b93671d5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1722 microversion: 2.1 time: 0.169645 Aug 29 19:05:58.560637 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 253/489] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:58 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:05:59.582494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9b5515ec-91b1-47a4-9dd4-81f1906251e1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:59.583215 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9b5515ec-91b1-47a4-9dd4-81f1906251e1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:59.589693 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b5515ec-91b1-47a4-9dd4-81f1906251e1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:59.590179 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b5515ec-91b1-47a4-9dd4-81f1906251e1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:59.590620 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b5515ec-91b1-47a4-9dd4-81f1906251e1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:59.591339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b5515ec-91b1-47a4-9dd4-81f1906251e1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:59.591795 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b5515ec-91b1-47a4-9dd4-81f1906251e1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:59.592217 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b5515ec-91b1-47a4-9dd4-81f1906251e1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:59.600553 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4e1458c5-5eba-42a3-926b-03772f4a83ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:59.601265 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4e1458c5-5eba-42a3-926b-03772f4a83ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:05:59.607770 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e1458c5-5eba-42a3-926b-03772f4a83ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:59.608255 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e1458c5-5eba-42a3-926b-03772f4a83ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:59.608689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e1458c5-5eba-42a3-926b-03772f4a83ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:59.609375 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e1458c5-5eba-42a3-926b-03772f4a83ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:59.609831 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e1458c5-5eba-42a3-926b-03772f4a83ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:59.610250 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e1458c5-5eba-42a3-926b-03772f4a83ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:59.633848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4e1458c5-5eba-42a3-926b-03772f4a83ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/ips" status: 200 len: 151 microversion: 2.20 time: 0.037678 Aug 29 19:05:59.634752 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 254/490] 10.222.0.86 () {60 vars in 1289 bytes} [Mon Aug 29 19:05:59 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:05:59.731604 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9b5515ec-91b1-47a4-9dd4-81f1906251e1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:05:59.740058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9b5515ec-91b1-47a4-9dd4-81f1906251e1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1722 microversion: 2.1 time: 0.162266 Aug 29 19:05:59.740640 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 237/491] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:05:59 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:00.761102 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e900cf47-4b0d-4e65-ac41-a8d8a905d911 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:00.761747 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e900cf47-4b0d-4e65-ac41-a8d8a905d911 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:00.767657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e900cf47-4b0d-4e65-ac41-a8d8a905d911 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:00.768137 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e900cf47-4b0d-4e65-ac41-a8d8a905d911 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:00.768567 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e900cf47-4b0d-4e65-ac41-a8d8a905d911 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:00.769248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e900cf47-4b0d-4e65-ac41-a8d8a905d911 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:00.769702 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e900cf47-4b0d-4e65-ac41-a8d8a905d911 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:00.770125 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e900cf47-4b0d-4e65-ac41-a8d8a905d911 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:00.894546 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e900cf47-4b0d-4e65-ac41-a8d8a905d911 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:00.902947 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e900cf47-4b0d-4e65-ac41-a8d8a905d911 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1722 microversion: 2.1 time: 0.145850 Aug 29 19:06:00.903532 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 255/492] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:00 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:01.924582 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-971dd42e-d8b0-440f-b44f-acd1c53c7301 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:01.925127 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-971dd42e-d8b0-440f-b44f-acd1c53c7301 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:01.932218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-971dd42e-d8b0-440f-b44f-acd1c53c7301 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:01.932707 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-971dd42e-d8b0-440f-b44f-acd1c53c7301 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:01.933146 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-971dd42e-d8b0-440f-b44f-acd1c53c7301 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:01.933839 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-971dd42e-d8b0-440f-b44f-acd1c53c7301 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:01.934294 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-971dd42e-d8b0-440f-b44f-acd1c53c7301 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:01.934715 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-971dd42e-d8b0-440f-b44f-acd1c53c7301 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:02.068625 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-971dd42e-d8b0-440f-b44f-acd1c53c7301 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:02.077073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-971dd42e-d8b0-440f-b44f-acd1c53c7301 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1722 microversion: 2.1 time: 0.156445 Aug 29 19:06:02.077636 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 238/493] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:01 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:02.627440 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7ee06ca5-6f72-4ca0-895a-36ffe6bc2757 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:06:02.628033 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7ee06ca5-6f72-4ca0-895a-36ffe6bc2757 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:02.634364 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ee06ca5-6f72-4ca0-895a-36ffe6bc2757 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:02.634843 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ee06ca5-6f72-4ca0-895a-36ffe6bc2757 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:02.635312 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ee06ca5-6f72-4ca0-895a-36ffe6bc2757 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:02.636003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ee06ca5-6f72-4ca0-895a-36ffe6bc2757 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:02.636448 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ee06ca5-6f72-4ca0-895a-36ffe6bc2757 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:02.636867 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ee06ca5-6f72-4ca0-895a-36ffe6bc2757 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:02.658973 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-7ee06ca5-6f72-4ca0-895a-36ffe6bc2757 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lazy-loading 'flavor' on Instance uuid 55705ba3-2981-43e1-80e0-29995ee472a9 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:06:02.840049 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7ee06ca5-6f72-4ca0-895a-36ffe6bc2757 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "POST /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/action" status: 202 len: 0 microversion: 2.20 time: 0.216481 Aug 29 19:06:02.840629 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 256/494] 10.222.0.86 () {62 vars in 1319 bytes} [Mon Aug 29 19:06:02 2022] POST /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:06:02.849383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6245c998-d77d-4080-bba2-24c029f7fa0f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:02.849987 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6245c998-d77d-4080-bba2-24c029f7fa0f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:02.856121 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6245c998-d77d-4080-bba2-24c029f7fa0f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:02.856601 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6245c998-d77d-4080-bba2-24c029f7fa0f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:02.857029 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6245c998-d77d-4080-bba2-24c029f7fa0f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:02.857758 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6245c998-d77d-4080-bba2-24c029f7fa0f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:02.858202 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6245c998-d77d-4080-bba2-24c029f7fa0f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:02.858612 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6245c998-d77d-4080-bba2-24c029f7fa0f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:02.998353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6245c998-d77d-4080-bba2-24c029f7fa0f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:03.006389 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6245c998-d77d-4080-bba2-24c029f7fa0f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:03.008026 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6245c998-d77d-4080-bba2-24c029f7fa0f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:03.009268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6245c998-d77d-4080-bba2-24c029f7fa0f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.164303 Aug 29 19:06:03.009815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 239/495] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:02 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:03.099705 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-44415bec-07af-4fc8-b5de-de363ac010b8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:03.100420 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-44415bec-07af-4fc8-b5de-de363ac010b8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:03.106685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44415bec-07af-4fc8-b5de-de363ac010b8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:03.107209 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44415bec-07af-4fc8-b5de-de363ac010b8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:03.107644 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44415bec-07af-4fc8-b5de-de363ac010b8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:03.108324 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44415bec-07af-4fc8-b5de-de363ac010b8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:03.108772 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44415bec-07af-4fc8-b5de-de363ac010b8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:03.109218 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44415bec-07af-4fc8-b5de-de363ac010b8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:03.243481 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-44415bec-07af-4fc8-b5de-de363ac010b8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:03.249415 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-11629580-271a-40ab-b1df-e2342c2a5959 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f11a63e-2dee-4402-b43c-09eac6d28ca2", "device": "/dev/sdb"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:06:03.251742 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-44415bec-07af-4fc8-b5de-de363ac010b8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1722 microversion: 2.1 time: 0.156984 Aug 29 19:06:03.252270 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-11629580-271a-40ab-b1df-e2342c2a5959 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:03.252395 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 257/496] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:03 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:03.258579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11629580-271a-40ab-b1df-e2342c2a5959 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:03.259064 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11629580-271a-40ab-b1df-e2342c2a5959 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:03.259493 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11629580-271a-40ab-b1df-e2342c2a5959 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:03.260174 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11629580-271a-40ab-b1df-e2342c2a5959 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:03.260620 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11629580-271a-40ab-b1df-e2342c2a5959 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:03.261037 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11629580-271a-40ab-b1df-e2342c2a5959 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:03.534791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-11629580-271a-40ab-b1df-e2342c2a5959 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "POST /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288927 Aug 29 19:06:03.536237 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 240/497] 10.222.0.86 () {60 vars in 1323 bytes} [Mon Aug 29 19:06:03 2022] POST /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:06:04.033547 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-50fe8692-eb0f-4045-9950-189b432cfbf7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:04.034069 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-50fe8692-eb0f-4045-9950-189b432cfbf7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:04.042111 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50fe8692-eb0f-4045-9950-189b432cfbf7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:04.042603 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50fe8692-eb0f-4045-9950-189b432cfbf7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:04.043066 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50fe8692-eb0f-4045-9950-189b432cfbf7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:04.043761 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50fe8692-eb0f-4045-9950-189b432cfbf7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:04.044210 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50fe8692-eb0f-4045-9950-189b432cfbf7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:04.044630 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50fe8692-eb0f-4045-9950-189b432cfbf7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:04.179255 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-50fe8692-eb0f-4045-9950-189b432cfbf7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:04.187253 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-50fe8692-eb0f-4045-9950-189b432cfbf7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:04.188698 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-50fe8692-eb0f-4045-9950-189b432cfbf7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:04.189850 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-50fe8692-eb0f-4045-9950-189b432cfbf7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.160298 Aug 29 19:06:04.190399 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 258/498] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:04 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:04.276134 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-060cc8a7-5a82-4951-aff8-5e414d983fa1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:04.276814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-060cc8a7-5a82-4951-aff8-5e414d983fa1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:04.282909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-060cc8a7-5a82-4951-aff8-5e414d983fa1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:04.283423 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-060cc8a7-5a82-4951-aff8-5e414d983fa1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:04.283914 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-060cc8a7-5a82-4951-aff8-5e414d983fa1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:04.284596 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-060cc8a7-5a82-4951-aff8-5e414d983fa1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:04.285244 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-060cc8a7-5a82-4951-aff8-5e414d983fa1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:04.285695 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-060cc8a7-5a82-4951-aff8-5e414d983fa1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:04.420894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-060cc8a7-5a82-4951-aff8-5e414d983fa1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:04.429120 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-060cc8a7-5a82-4951-aff8-5e414d983fa1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1722 microversion: 2.1 time: 0.157871 Aug 29 19:06:04.429679 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 241/499] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:04 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:05.212817 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e8e63ee9-380e-4583-81c7-815530101ec6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:05.213510 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e8e63ee9-380e-4583-81c7-815530101ec6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:05.219830 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e8e63ee9-380e-4583-81c7-815530101ec6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:05.220314 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e8e63ee9-380e-4583-81c7-815530101ec6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:05.220730 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e8e63ee9-380e-4583-81c7-815530101ec6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:05.221470 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e8e63ee9-380e-4583-81c7-815530101ec6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:05.222110 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e8e63ee9-380e-4583-81c7-815530101ec6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:05.222545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e8e63ee9-380e-4583-81c7-815530101ec6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:05.394096 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e8e63ee9-380e-4583-81c7-815530101ec6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:05.399445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e8e63ee9-380e-4583-81c7-815530101ec6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:05.400831 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e8e63ee9-380e-4583-81c7-815530101ec6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:05.402041 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e8e63ee9-380e-4583-81c7-815530101ec6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.193110 Aug 29 19:06:05.402629 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 259/500] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:05 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:05.452170 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-87498ebd-2810-4784-b452-7524788cfc77 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:05.454749 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-87498ebd-2810-4784-b452-7524788cfc77 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:05.467921 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-87498ebd-2810-4784-b452-7524788cfc77 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:05.468486 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-87498ebd-2810-4784-b452-7524788cfc77 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:05.468930 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-87498ebd-2810-4784-b452-7524788cfc77 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:05.469650 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-87498ebd-2810-4784-b452-7524788cfc77 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:05.470099 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-87498ebd-2810-4784-b452-7524788cfc77 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:05.470519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-87498ebd-2810-4784-b452-7524788cfc77 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:05.618740 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-87498ebd-2810-4784-b452-7524788cfc77 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:05.627134 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-87498ebd-2810-4784-b452-7524788cfc77 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1722 microversion: 2.1 time: 0.178889 Aug 29 19:06:05.627700 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 242/501] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:05 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:06.426044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-08114f62-41ee-4ef5-8258-9321f6c8a3cd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:06.427652 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-08114f62-41ee-4ef5-8258-9321f6c8a3cd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:06.433461 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08114f62-41ee-4ef5-8258-9321f6c8a3cd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:06.433939 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08114f62-41ee-4ef5-8258-9321f6c8a3cd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:06.434366 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08114f62-41ee-4ef5-8258-9321f6c8a3cd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:06.435075 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08114f62-41ee-4ef5-8258-9321f6c8a3cd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:06.435523 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08114f62-41ee-4ef5-8258-9321f6c8a3cd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:06.435936 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08114f62-41ee-4ef5-8258-9321f6c8a3cd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:06.564353 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-08114f62-41ee-4ef5-8258-9321f6c8a3cd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:06.573430 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-08114f62-41ee-4ef5-8258-9321f6c8a3cd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:06.574873 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-08114f62-41ee-4ef5-8258-9321f6c8a3cd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:06.576052 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-08114f62-41ee-4ef5-8258-9321f6c8a3cd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.153930 Aug 29 19:06:06.576612 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 260/502] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:06 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:06:06.647779 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-55b00d18-ead2-460c-aa9e-220c3d2e93ee tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:06.648382 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-55b00d18-ead2-460c-aa9e-220c3d2e93ee tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:06.654662 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55b00d18-ead2-460c-aa9e-220c3d2e93ee tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:06.655175 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55b00d18-ead2-460c-aa9e-220c3d2e93ee tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:06.655600 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55b00d18-ead2-460c-aa9e-220c3d2e93ee tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:06.656276 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55b00d18-ead2-460c-aa9e-220c3d2e93ee tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:06.656725 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55b00d18-ead2-460c-aa9e-220c3d2e93ee tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:06.657142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55b00d18-ead2-460c-aa9e-220c3d2e93ee tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:06.789865 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-55b00d18-ead2-460c-aa9e-220c3d2e93ee tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:06.798129 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-55b00d18-ead2-460c-aa9e-220c3d2e93ee tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1722 microversion: 2.1 time: 0.154187 Aug 29 19:06:06.798687 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 243/503] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:06 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:07.599490 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2f915666-a35d-467d-8d5b-e4d5d8e13003 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:07.600097 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2f915666-a35d-467d-8d5b-e4d5d8e13003 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:07.606466 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f915666-a35d-467d-8d5b-e4d5d8e13003 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:07.606933 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f915666-a35d-467d-8d5b-e4d5d8e13003 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:07.607396 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f915666-a35d-467d-8d5b-e4d5d8e13003 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:07.608079 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f915666-a35d-467d-8d5b-e4d5d8e13003 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:07.608529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f915666-a35d-467d-8d5b-e4d5d8e13003 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:07.608949 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f915666-a35d-467d-8d5b-e4d5d8e13003 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:07.736224 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2f915666-a35d-467d-8d5b-e4d5d8e13003 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:07.745099 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2f915666-a35d-467d-8d5b-e4d5d8e13003 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:07.746547 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2f915666-a35d-467d-8d5b-e4d5d8e13003 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:07.747733 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2f915666-a35d-467d-8d5b-e4d5d8e13003 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.152765 Aug 29 19:06:07.748295 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 261/504] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:07 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:06:07.819612 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-418c6c67-e56b-4974-b3d9-002c9c24824c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:07.820222 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-418c6c67-e56b-4974-b3d9-002c9c24824c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:07.826568 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-418c6c67-e56b-4974-b3d9-002c9c24824c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:07.827084 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-418c6c67-e56b-4974-b3d9-002c9c24824c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:07.827520 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-418c6c67-e56b-4974-b3d9-002c9c24824c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:07.828208 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-418c6c67-e56b-4974-b3d9-002c9c24824c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:07.828658 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-418c6c67-e56b-4974-b3d9-002c9c24824c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:07.829082 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-418c6c67-e56b-4974-b3d9-002c9c24824c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:07.955031 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-418c6c67-e56b-4974-b3d9-002c9c24824c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:07.963077 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-418c6c67-e56b-4974-b3d9-002c9c24824c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1722 microversion: 2.1 time: 0.147550 Aug 29 19:06:07.963635 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 244/505] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:07 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:08.770100 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0e409f81-873f-4112-9359-7d24d7b11041 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:08.770698 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0e409f81-873f-4112-9359-7d24d7b11041 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:08.777205 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e409f81-873f-4112-9359-7d24d7b11041 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:08.777680 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e409f81-873f-4112-9359-7d24d7b11041 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:08.778107 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e409f81-873f-4112-9359-7d24d7b11041 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:08.778785 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e409f81-873f-4112-9359-7d24d7b11041 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:08.779258 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e409f81-873f-4112-9359-7d24d7b11041 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:08.779673 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e409f81-873f-4112-9359-7d24d7b11041 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:08.910492 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0e409f81-873f-4112-9359-7d24d7b11041 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:08.918453 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0e409f81-873f-4112-9359-7d24d7b11041 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:08.919919 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0e409f81-873f-4112-9359-7d24d7b11041 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:08.921036 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0e409f81-873f-4112-9359-7d24d7b11041 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.155341 Aug 29 19:06:08.921570 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 262/506] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:08 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:08.984443 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-77d898d7-9855-4666-8a74-4596763b7f07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:08.985072 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-77d898d7-9855-4666-8a74-4596763b7f07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:08.991680 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-77d898d7-9855-4666-8a74-4596763b7f07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:08.992171 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-77d898d7-9855-4666-8a74-4596763b7f07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:08.992656 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-77d898d7-9855-4666-8a74-4596763b7f07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:08.993307 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-77d898d7-9855-4666-8a74-4596763b7f07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:08.993758 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-77d898d7-9855-4666-8a74-4596763b7f07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:08.994183 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-77d898d7-9855-4666-8a74-4596763b7f07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:09.122338 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-77d898d7-9855-4666-8a74-4596763b7f07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:09.130855 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-77d898d7-9855-4666-8a74-4596763b7f07 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1722 microversion: 2.1 time: 0.150279 Aug 29 19:06:09.131433 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 245/507] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:08 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:09.944003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f2a96ecd-22ec-4564-a184-e0d078efb4b4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:09.944966 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f2a96ecd-22ec-4564-a184-e0d078efb4b4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:09.951272 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f2a96ecd-22ec-4564-a184-e0d078efb4b4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:09.951751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f2a96ecd-22ec-4564-a184-e0d078efb4b4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:09.952182 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f2a96ecd-22ec-4564-a184-e0d078efb4b4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:09.952868 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f2a96ecd-22ec-4564-a184-e0d078efb4b4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:09.953317 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f2a96ecd-22ec-4564-a184-e0d078efb4b4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:09.953735 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f2a96ecd-22ec-4564-a184-e0d078efb4b4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:10.087454 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f2a96ecd-22ec-4564-a184-e0d078efb4b4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:10.101639 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f2a96ecd-22ec-4564-a184-e0d078efb4b4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:10.103527 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f2a96ecd-22ec-4564-a184-e0d078efb4b4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:10.104742 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f2a96ecd-22ec-4564-a184-e0d078efb4b4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.165177 Aug 29 19:06:10.105302 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 263/508] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:09 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:10.152268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0bd0b707-8941-42d3-9689-f42340e9d7c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:10.152868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0bd0b707-8941-42d3-9689-f42340e9d7c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:10.159193 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0bd0b707-8941-42d3-9689-f42340e9d7c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:10.159699 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0bd0b707-8941-42d3-9689-f42340e9d7c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:10.160124 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0bd0b707-8941-42d3-9689-f42340e9d7c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:10.160797 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0bd0b707-8941-42d3-9689-f42340e9d7c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:10.161240 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0bd0b707-8941-42d3-9689-f42340e9d7c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:10.161650 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0bd0b707-8941-42d3-9689-f42340e9d7c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:10.288363 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0bd0b707-8941-42d3-9689-f42340e9d7c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:10.296460 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0bd0b707-8941-42d3-9689-f42340e9d7c3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1722 microversion: 2.1 time: 0.148092 Aug 29 19:06:10.297014 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 246/509] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:10 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:11.127446 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-94ab3b58-938e-429a-8730-d176f5df972b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:11.128132 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-94ab3b58-938e-429a-8730-d176f5df972b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:11.134718 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94ab3b58-938e-429a-8730-d176f5df972b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:11.135245 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94ab3b58-938e-429a-8730-d176f5df972b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:11.135672 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94ab3b58-938e-429a-8730-d176f5df972b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:11.136367 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94ab3b58-938e-429a-8730-d176f5df972b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:11.136846 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94ab3b58-938e-429a-8730-d176f5df972b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:11.137264 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94ab3b58-938e-429a-8730-d176f5df972b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:11.277925 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-94ab3b58-938e-429a-8730-d176f5df972b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:11.286094 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-94ab3b58-938e-429a-8730-d176f5df972b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:11.287555 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-94ab3b58-938e-429a-8730-d176f5df972b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:11.288695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-94ab3b58-938e-429a-8730-d176f5df972b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.165077 Aug 29 19:06:11.289248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 264/510] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:11 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:11.318323 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-632b264e-d80b-42a2-8a65-46d446ac5a39 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:11.318936 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-632b264e-d80b-42a2-8a65-46d446ac5a39 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:11.325533 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-632b264e-d80b-42a2-8a65-46d446ac5a39 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:11.326018 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-632b264e-d80b-42a2-8a65-46d446ac5a39 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:11.326455 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-632b264e-d80b-42a2-8a65-46d446ac5a39 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:11.327188 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-632b264e-d80b-42a2-8a65-46d446ac5a39 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:11.327643 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-632b264e-d80b-42a2-8a65-46d446ac5a39 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:11.328209 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-632b264e-d80b-42a2-8a65-46d446ac5a39 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:11.456262 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-632b264e-d80b-42a2-8a65-46d446ac5a39 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:11.464441 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-632b264e-d80b-42a2-8a65-46d446ac5a39 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1722 microversion: 2.1 time: 0.150693 Aug 29 19:06:11.465003 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 247/511] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:11 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:12.311488 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f945ea98-7934-4045-bfc8-3e822356ed8c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:12.312106 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f945ea98-7934-4045-bfc8-3e822356ed8c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:12.318474 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f945ea98-7934-4045-bfc8-3e822356ed8c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:12.318959 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f945ea98-7934-4045-bfc8-3e822356ed8c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:12.319712 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f945ea98-7934-4045-bfc8-3e822356ed8c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:12.320405 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f945ea98-7934-4045-bfc8-3e822356ed8c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:12.320880 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f945ea98-7934-4045-bfc8-3e822356ed8c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:12.321456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f945ea98-7934-4045-bfc8-3e822356ed8c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:12.449326 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f945ea98-7934-4045-bfc8-3e822356ed8c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:12.457214 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f945ea98-7934-4045-bfc8-3e822356ed8c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:12.458683 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f945ea98-7934-4045-bfc8-3e822356ed8c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:12.459864 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f945ea98-7934-4045-bfc8-3e822356ed8c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.152211 Aug 29 19:06:12.460417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 265/512] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:12 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:12.485759 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fe6f11f0-5986-4f77-a866-f920322b1c13 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:12.486368 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fe6f11f0-5986-4f77-a866-f920322b1c13 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:12.493521 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe6f11f0-5986-4f77-a866-f920322b1c13 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:12.494002 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe6f11f0-5986-4f77-a866-f920322b1c13 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:12.494431 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe6f11f0-5986-4f77-a866-f920322b1c13 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:12.495142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe6f11f0-5986-4f77-a866-f920322b1c13 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:12.495594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe6f11f0-5986-4f77-a866-f920322b1c13 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:12.496012 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe6f11f0-5986-4f77-a866-f920322b1c13 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:12.626376 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fe6f11f0-5986-4f77-a866-f920322b1c13 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:12.634571 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fe6f11f0-5986-4f77-a866-f920322b1c13 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1722 microversion: 2.1 time: 0.152668 Aug 29 19:06:12.635159 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 248/513] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:12 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:13.483363 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-244618c6-3514-413b-bb65-f7015d492948 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:13.483962 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-244618c6-3514-413b-bb65-f7015d492948 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:13.490265 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-244618c6-3514-413b-bb65-f7015d492948 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:13.490739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-244618c6-3514-413b-bb65-f7015d492948 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:13.491203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-244618c6-3514-413b-bb65-f7015d492948 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:13.491896 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-244618c6-3514-413b-bb65-f7015d492948 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:13.492320 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-244618c6-3514-413b-bb65-f7015d492948 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:13.492739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-244618c6-3514-413b-bb65-f7015d492948 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:13.633558 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-244618c6-3514-413b-bb65-f7015d492948 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:13.641624 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-244618c6-3514-413b-bb65-f7015d492948 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:13.643084 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-244618c6-3514-413b-bb65-f7015d492948 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:13.644345 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-244618c6-3514-413b-bb65-f7015d492948 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.164791 Aug 29 19:06:13.645387 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 266/514] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:13 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:13.656193 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-737d76fe-a698-4319-a3c3-d6270177d350 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:13.656797 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-737d76fe-a698-4319-a3c3-d6270177d350 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:13.663233 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-737d76fe-a698-4319-a3c3-d6270177d350 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:13.663710 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-737d76fe-a698-4319-a3c3-d6270177d350 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:13.664139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-737d76fe-a698-4319-a3c3-d6270177d350 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:13.664822 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-737d76fe-a698-4319-a3c3-d6270177d350 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:13.665264 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-737d76fe-a698-4319-a3c3-d6270177d350 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:13.665679 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-737d76fe-a698-4319-a3c3-d6270177d350 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:13.796124 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-737d76fe-a698-4319-a3c3-d6270177d350 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:13.804193 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-737d76fe-a698-4319-a3c3-d6270177d350 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1722 microversion: 2.1 time: 0.151804 Aug 29 19:06:13.804745 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 249/515] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:13 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:14.667495 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-06956fc0-d012-4b61-bf3b-b0c292e63235 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:14.668093 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-06956fc0-d012-4b61-bf3b-b0c292e63235 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:14.674287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06956fc0-d012-4b61-bf3b-b0c292e63235 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:14.674763 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06956fc0-d012-4b61-bf3b-b0c292e63235 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:14.675227 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06956fc0-d012-4b61-bf3b-b0c292e63235 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:14.675914 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06956fc0-d012-4b61-bf3b-b0c292e63235 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:14.676363 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06956fc0-d012-4b61-bf3b-b0c292e63235 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:14.676780 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06956fc0-d012-4b61-bf3b-b0c292e63235 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:14.804815 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-06956fc0-d012-4b61-bf3b-b0c292e63235 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:14.808453 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:06:14.814139 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-06956fc0-d012-4b61-bf3b-b0c292e63235 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:14.815610 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-06956fc0-d012-4b61-bf3b-b0c292e63235 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:14.817296 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-06956fc0-d012-4b61-bf3b-b0c292e63235 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.153864 Aug 29 19:06:14.817845 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 267/516] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:14 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:14.825726 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-61c0cd8b-308f-47df-a6a1-509f0ff197be tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:14.826442 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-61c0cd8b-308f-47df-a6a1-509f0ff197be tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:14.833253 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61c0cd8b-308f-47df-a6a1-509f0ff197be tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:14.833755 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61c0cd8b-308f-47df-a6a1-509f0ff197be tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:14.834222 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61c0cd8b-308f-47df-a6a1-509f0ff197be tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:14.834989 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61c0cd8b-308f-47df-a6a1-509f0ff197be tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:14.835496 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61c0cd8b-308f-47df-a6a1-509f0ff197be tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:14.835922 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61c0cd8b-308f-47df-a6a1-509f0ff197be tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:14.840078 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:06:14.963472 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-61c0cd8b-308f-47df-a6a1-509f0ff197be tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:14.971672 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-61c0cd8b-308f-47df-a6a1-509f0ff197be tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1722 microversion: 2.1 time: 0.149753 Aug 29 19:06:14.972574 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 250/517] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:14 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:15.840568 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d4676494-759e-4e53-97d7-ae1abb818ec4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:15.841092 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d4676494-759e-4e53-97d7-ae1abb818ec4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:15.848092 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4676494-759e-4e53-97d7-ae1abb818ec4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:15.848572 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4676494-759e-4e53-97d7-ae1abb818ec4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:15.848997 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4676494-759e-4e53-97d7-ae1abb818ec4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:15.849674 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4676494-759e-4e53-97d7-ae1abb818ec4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:15.850117 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4676494-759e-4e53-97d7-ae1abb818ec4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:15.850532 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4676494-759e-4e53-97d7-ae1abb818ec4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:15.980082 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d4676494-759e-4e53-97d7-ae1abb818ec4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:15.988699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d4676494-759e-4e53-97d7-ae1abb818ec4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:15.990142 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d4676494-759e-4e53-97d7-ae1abb818ec4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:15.991321 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d4676494-759e-4e53-97d7-ae1abb818ec4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.155483 Aug 29 19:06:15.991875 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 268/518] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:15 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:15.992947 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e05ee285-d8af-4584-8d9f-750503cebade tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:15.993561 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e05ee285-d8af-4584-8d9f-750503cebade tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:16.000022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e05ee285-d8af-4584-8d9f-750503cebade tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:16.000500 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e05ee285-d8af-4584-8d9f-750503cebade tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:16.000931 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e05ee285-d8af-4584-8d9f-750503cebade tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:16.001617 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e05ee285-d8af-4584-8d9f-750503cebade tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:16.002067 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e05ee285-d8af-4584-8d9f-750503cebade tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:16.002487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e05ee285-d8af-4584-8d9f-750503cebade tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:16.127948 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e05ee285-d8af-4584-8d9f-750503cebade tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:16.137158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e05ee285-d8af-4584-8d9f-750503cebade tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1699 microversion: 2.1 time: 0.147938 Aug 29 19:06:16.137835 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 251/519] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:15 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1699 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:06:16.160496 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-539c2773-0c29-4559-a7e6-a5ff5b4ebbd1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:06:16.166442 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-539c2773-0c29-4559-a7e6-a5ff5b4ebbd1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:16.166915 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-539c2773-0c29-4559-a7e6-a5ff5b4ebbd1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:16.167377 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-539c2773-0c29-4559-a7e6-a5ff5b4ebbd1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:16.227138 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-539c2773-0c29-4559-a7e6-a5ff5b4ebbd1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Going to try to start instance {{(pid=120707) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 19:06:16.267371 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-539c2773-0c29-4559-a7e6-a5ff5b4ebbd1 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "POST /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/action" status: 202 len: 0 microversion: 2.1 time: 0.111440 Aug 29 19:06:16.267954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 269/520] 10.222.0.86 () {60 vars in 1278 bytes} [Mon Aug 29 19:06:16 2022] POST /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:06:16.276607 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2a92a1bb-f79b-4686-a9b0-89bfefdd9201 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:16.277309 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2a92a1bb-f79b-4686-a9b0-89bfefdd9201 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:16.283325 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a92a1bb-f79b-4686-a9b0-89bfefdd9201 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:16.283817 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a92a1bb-f79b-4686-a9b0-89bfefdd9201 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:16.284281 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a92a1bb-f79b-4686-a9b0-89bfefdd9201 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:16.285566 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a92a1bb-f79b-4686-a9b0-89bfefdd9201 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:16.285988 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a92a1bb-f79b-4686-a9b0-89bfefdd9201 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:16.286403 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a92a1bb-f79b-4686-a9b0-89bfefdd9201 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:16.430217 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2a92a1bb-f79b-4686-a9b0-89bfefdd9201 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:16.440375 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2a92a1bb-f79b-4686-a9b0-89bfefdd9201 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1708 microversion: 2.1 time: 0.167607 Aug 29 19:06:16.441441 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 252/521] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:16 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1708 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:17.014588 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-130f7ff8-0e35-4f02-ac67-25197906174c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:17.015960 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-130f7ff8-0e35-4f02-ac67-25197906174c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:17.023430 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-130f7ff8-0e35-4f02-ac67-25197906174c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:17.023924 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-130f7ff8-0e35-4f02-ac67-25197906174c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:17.024366 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-130f7ff8-0e35-4f02-ac67-25197906174c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:17.025067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-130f7ff8-0e35-4f02-ac67-25197906174c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:17.025517 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-130f7ff8-0e35-4f02-ac67-25197906174c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:17.025936 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-130f7ff8-0e35-4f02-ac67-25197906174c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:17.232952 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-130f7ff8-0e35-4f02-ac67-25197906174c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:17.240949 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-130f7ff8-0e35-4f02-ac67-25197906174c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:17.242399 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-130f7ff8-0e35-4f02-ac67-25197906174c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:17.243674 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-130f7ff8-0e35-4f02-ac67-25197906174c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.233449 Aug 29 19:06:17.244248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 270/522] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:17 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:17.462611 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-085e7f96-9895-435c-a87e-bd95cb0edbe2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:17.463221 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-085e7f96-9895-435c-a87e-bd95cb0edbe2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:17.469608 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-085e7f96-9895-435c-a87e-bd95cb0edbe2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:17.470084 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-085e7f96-9895-435c-a87e-bd95cb0edbe2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:17.470517 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-085e7f96-9895-435c-a87e-bd95cb0edbe2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:17.471241 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-085e7f96-9895-435c-a87e-bd95cb0edbe2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:17.471687 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-085e7f96-9895-435c-a87e-bd95cb0edbe2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:17.472104 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-085e7f96-9895-435c-a87e-bd95cb0edbe2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:17.600152 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-085e7f96-9895-435c-a87e-bd95cb0edbe2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:17.608667 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-085e7f96-9895-435c-a87e-bd95cb0edbe2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1708 microversion: 2.1 time: 0.149868 Aug 29 19:06:17.609230 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 253/523] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:17 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1708 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:18.265392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ae367b3b-a0e9-413f-93f2-92e86354fd7c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:18.265999 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ae367b3b-a0e9-413f-93f2-92e86354fd7c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:18.273089 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae367b3b-a0e9-413f-93f2-92e86354fd7c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:18.273568 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae367b3b-a0e9-413f-93f2-92e86354fd7c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:18.274000 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae367b3b-a0e9-413f-93f2-92e86354fd7c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:18.274679 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae367b3b-a0e9-413f-93f2-92e86354fd7c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:18.275214 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae367b3b-a0e9-413f-93f2-92e86354fd7c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:18.275576 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae367b3b-a0e9-413f-93f2-92e86354fd7c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:18.401280 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ae367b3b-a0e9-413f-93f2-92e86354fd7c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:18.409274 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ae367b3b-a0e9-413f-93f2-92e86354fd7c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:18.410722 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ae367b3b-a0e9-413f-93f2-92e86354fd7c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:18.411904 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ae367b3b-a0e9-413f-93f2-92e86354fd7c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.150388 Aug 29 19:06:18.412464 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 271/524] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:18 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:18.630073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-dfda5357-099b-4a0c-ada7-bc3320e7dcfe tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:18.630620 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-dfda5357-099b-4a0c-ada7-bc3320e7dcfe tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:18.637018 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dfda5357-099b-4a0c-ada7-bc3320e7dcfe tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:18.637502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dfda5357-099b-4a0c-ada7-bc3320e7dcfe tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:18.637931 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dfda5357-099b-4a0c-ada7-bc3320e7dcfe tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:18.638616 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dfda5357-099b-4a0c-ada7-bc3320e7dcfe tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:18.639092 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dfda5357-099b-4a0c-ada7-bc3320e7dcfe tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:18.639515 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dfda5357-099b-4a0c-ada7-bc3320e7dcfe tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:18.770059 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-dfda5357-099b-4a0c-ada7-bc3320e7dcfe tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:18.778332 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-dfda5357-099b-4a0c-ada7-bc3320e7dcfe tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1708 microversion: 2.1 time: 0.152227 Aug 29 19:06:18.778902 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 254/525] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:18 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:19.436477 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1b3f849c-f3dd-4d72-9dfb-5bb47ad124e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:19.437262 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1b3f849c-f3dd-4d72-9dfb-5bb47ad124e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:19.443565 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b3f849c-f3dd-4d72-9dfb-5bb47ad124e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:19.444051 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b3f849c-f3dd-4d72-9dfb-5bb47ad124e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:19.444773 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b3f849c-f3dd-4d72-9dfb-5bb47ad124e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:19.445455 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b3f849c-f3dd-4d72-9dfb-5bb47ad124e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:19.446012 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b3f849c-f3dd-4d72-9dfb-5bb47ad124e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:19.446437 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b3f849c-f3dd-4d72-9dfb-5bb47ad124e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:19.572662 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1b3f849c-f3dd-4d72-9dfb-5bb47ad124e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:19.583719 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1b3f849c-f3dd-4d72-9dfb-5bb47ad124e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:19.585620 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1b3f849c-f3dd-4d72-9dfb-5bb47ad124e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:19.587682 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1b3f849c-f3dd-4d72-9dfb-5bb47ad124e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.155989 Aug 29 19:06:19.588485 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 272/526] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:19 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:19.799847 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-81d74d35-6ad1-4b88-9365-76eefaa4d303 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:19.800460 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-81d74d35-6ad1-4b88-9365-76eefaa4d303 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:19.807117 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d74d35-6ad1-4b88-9365-76eefaa4d303 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:19.807601 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d74d35-6ad1-4b88-9365-76eefaa4d303 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:19.808035 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d74d35-6ad1-4b88-9365-76eefaa4d303 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:19.808731 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d74d35-6ad1-4b88-9365-76eefaa4d303 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:19.809187 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d74d35-6ad1-4b88-9365-76eefaa4d303 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:19.809613 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d74d35-6ad1-4b88-9365-76eefaa4d303 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:19.936891 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-81d74d35-6ad1-4b88-9365-76eefaa4d303 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:19.946710 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-81d74d35-6ad1-4b88-9365-76eefaa4d303 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1708 microversion: 2.1 time: 0.150312 Aug 29 19:06:19.947248 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 255/527] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:19 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1708 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:20.611303 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-69ad38ad-baea-46bf-b9c4-45d2cf518553 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:20.611912 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-69ad38ad-baea-46bf-b9c4-45d2cf518553 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:20.618895 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69ad38ad-baea-46bf-b9c4-45d2cf518553 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:20.619412 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69ad38ad-baea-46bf-b9c4-45d2cf518553 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:20.619845 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69ad38ad-baea-46bf-b9c4-45d2cf518553 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:20.620530 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69ad38ad-baea-46bf-b9c4-45d2cf518553 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:20.620981 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69ad38ad-baea-46bf-b9c4-45d2cf518553 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:20.621400 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69ad38ad-baea-46bf-b9c4-45d2cf518553 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:20.752418 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-69ad38ad-baea-46bf-b9c4-45d2cf518553 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:20.760605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-69ad38ad-baea-46bf-b9c4-45d2cf518553 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:20.762085 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-69ad38ad-baea-46bf-b9c4-45d2cf518553 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:20.763261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-69ad38ad-baea-46bf-b9c4-45d2cf518553 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.155881 Aug 29 19:06:20.763820 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 273/528] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:20 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:20.968545 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-398caec9-a7e3-4335-8b09-29a81f61f3dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:20.969148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-398caec9-a7e3-4335-8b09-29a81f61f3dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:20.976420 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-398caec9-a7e3-4335-8b09-29a81f61f3dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:20.976909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-398caec9-a7e3-4335-8b09-29a81f61f3dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:20.977344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-398caec9-a7e3-4335-8b09-29a81f61f3dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:20.978040 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-398caec9-a7e3-4335-8b09-29a81f61f3dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:20.978493 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-398caec9-a7e3-4335-8b09-29a81f61f3dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:20.978939 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-398caec9-a7e3-4335-8b09-29a81f61f3dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:21.107629 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-398caec9-a7e3-4335-8b09-29a81f61f3dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:21.115899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-398caec9-a7e3-4335-8b09-29a81f61f3dc tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1708 microversion: 2.1 time: 0.151369 Aug 29 19:06:21.116457 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 256/529] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:20 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:21.787217 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e1f459a4-3c61-4fbb-a574-112079520ee0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:21.787849 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e1f459a4-3c61-4fbb-a574-112079520ee0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:21.794317 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1f459a4-3c61-4fbb-a574-112079520ee0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:21.794736 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1f459a4-3c61-4fbb-a574-112079520ee0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:21.795206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1f459a4-3c61-4fbb-a574-112079520ee0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:21.795893 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1f459a4-3c61-4fbb-a574-112079520ee0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:21.796343 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1f459a4-3c61-4fbb-a574-112079520ee0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:21.796764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1f459a4-3c61-4fbb-a574-112079520ee0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:21.926522 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e1f459a4-3c61-4fbb-a574-112079520ee0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:21.934786 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e1f459a4-3c61-4fbb-a574-112079520ee0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:21.936284 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e1f459a4-3c61-4fbb-a574-112079520ee0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:21.937437 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e1f459a4-3c61-4fbb-a574-112079520ee0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.154864 Aug 29 19:06:21.937985 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 274/530] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:21 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:22.137696 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-442ca2ac-6607-4ccb-9487-dffd80a761bf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:22.138237 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-442ca2ac-6607-4ccb-9487-dffd80a761bf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:22.146723 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-442ca2ac-6607-4ccb-9487-dffd80a761bf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:22.147299 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-442ca2ac-6607-4ccb-9487-dffd80a761bf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:22.147733 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-442ca2ac-6607-4ccb-9487-dffd80a761bf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:22.148426 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-442ca2ac-6607-4ccb-9487-dffd80a761bf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:22.148875 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-442ca2ac-6607-4ccb-9487-dffd80a761bf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:22.149293 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-442ca2ac-6607-4ccb-9487-dffd80a761bf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:22.274125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-442ca2ac-6607-4ccb-9487-dffd80a761bf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:22.282279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-442ca2ac-6607-4ccb-9487-dffd80a761bf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1708 microversion: 2.1 time: 0.148620 Aug 29 19:06:22.282843 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 257/531] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:22 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1708 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:22.962200 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a8536bd3-be66-43fa-974f-174e31252746 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:22.962944 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a8536bd3-be66-43fa-974f-174e31252746 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:22.970839 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8536bd3-be66-43fa-974f-174e31252746 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:22.971526 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8536bd3-be66-43fa-974f-174e31252746 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:22.971960 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8536bd3-be66-43fa-974f-174e31252746 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:22.972703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8536bd3-be66-43fa-974f-174e31252746 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:22.973152 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8536bd3-be66-43fa-974f-174e31252746 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:22.973574 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8536bd3-be66-43fa-974f-174e31252746 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:23.109297 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a8536bd3-be66-43fa-974f-174e31252746 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:23.117771 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a8536bd3-be66-43fa-974f-174e31252746 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:23.119239 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a8536bd3-be66-43fa-974f-174e31252746 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:23.120374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a8536bd3-be66-43fa-974f-174e31252746 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.162627 Aug 29 19:06:23.120927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 275/532] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:22 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:23.303605 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-94dfe153-4948-432e-a08a-6746d334f784 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:23.304217 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-94dfe153-4948-432e-a08a-6746d334f784 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:23.310613 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-94dfe153-4948-432e-a08a-6746d334f784 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:23.311137 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-94dfe153-4948-432e-a08a-6746d334f784 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:23.311573 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-94dfe153-4948-432e-a08a-6746d334f784 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:23.312253 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-94dfe153-4948-432e-a08a-6746d334f784 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:23.312753 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-94dfe153-4948-432e-a08a-6746d334f784 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:23.313119 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-94dfe153-4948-432e-a08a-6746d334f784 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:23.443900 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-94dfe153-4948-432e-a08a-6746d334f784 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:23.452333 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-94dfe153-4948-432e-a08a-6746d334f784 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1712 microversion: 2.1 time: 0.153095 Aug 29 19:06:23.452901 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 258/533] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:23 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1712 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:24.143393 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4da2d4c5-8546-4a06-a14d-ca1eb9d91563 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:24.143995 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4da2d4c5-8546-4a06-a14d-ca1eb9d91563 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:24.150740 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4da2d4c5-8546-4a06-a14d-ca1eb9d91563 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:24.151256 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4da2d4c5-8546-4a06-a14d-ca1eb9d91563 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:24.151688 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4da2d4c5-8546-4a06-a14d-ca1eb9d91563 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:24.152376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4da2d4c5-8546-4a06-a14d-ca1eb9d91563 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:24.152826 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4da2d4c5-8546-4a06-a14d-ca1eb9d91563 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:24.153245 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4da2d4c5-8546-4a06-a14d-ca1eb9d91563 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:24.279349 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4da2d4c5-8546-4a06-a14d-ca1eb9d91563 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:24.287999 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4da2d4c5-8546-4a06-a14d-ca1eb9d91563 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:24.289533 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4da2d4c5-8546-4a06-a14d-ca1eb9d91563 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:24.290687 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4da2d4c5-8546-4a06-a14d-ca1eb9d91563 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.151161 Aug 29 19:06:24.291279 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 276/534] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:24 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:25.313845 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-445c535a-5391-4ebc-bf9b-6e4554591887 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:25.314450 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-445c535a-5391-4ebc-bf9b-6e4554591887 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:25.321339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-445c535a-5391-4ebc-bf9b-6e4554591887 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:25.321821 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-445c535a-5391-4ebc-bf9b-6e4554591887 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:25.322248 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-445c535a-5391-4ebc-bf9b-6e4554591887 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:25.322925 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-445c535a-5391-4ebc-bf9b-6e4554591887 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:25.323551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-445c535a-5391-4ebc-bf9b-6e4554591887 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:25.323964 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-445c535a-5391-4ebc-bf9b-6e4554591887 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:25.459120 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-445c535a-5391-4ebc-bf9b-6e4554591887 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:25.467185 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-445c535a-5391-4ebc-bf9b-6e4554591887 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:25.468626 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-445c535a-5391-4ebc-bf9b-6e4554591887 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:25.469764 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-445c535a-5391-4ebc-bf9b-6e4554591887 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.159805 Aug 29 19:06:25.470319 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 259/535] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:25 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:06:26.493471 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d9517456-db36-4548-b2b6-9af6e0ce52ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:26.494010 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d9517456-db36-4548-b2b6-9af6e0ce52ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:26.500417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d9517456-db36-4548-b2b6-9af6e0ce52ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:26.500898 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d9517456-db36-4548-b2b6-9af6e0ce52ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:26.501362 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d9517456-db36-4548-b2b6-9af6e0ce52ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:26.502104 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d9517456-db36-4548-b2b6-9af6e0ce52ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:26.502558 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d9517456-db36-4548-b2b6-9af6e0ce52ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:26.502984 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d9517456-db36-4548-b2b6-9af6e0ce52ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:26.630557 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d9517456-db36-4548-b2b6-9af6e0ce52ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:26.639029 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d9517456-db36-4548-b2b6-9af6e0ce52ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:26.640468 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d9517456-db36-4548-b2b6-9af6e0ce52ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:26.641614 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d9517456-db36-4548-b2b6-9af6e0ce52ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.152110 Aug 29 19:06:26.642162 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 277/536] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:26 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:27.664803 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-42e53c4b-fd34-45a5-9cf0-0a72e4644a42 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:27.665408 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-42e53c4b-fd34-45a5-9cf0-0a72e4644a42 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:27.671903 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-42e53c4b-fd34-45a5-9cf0-0a72e4644a42 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:27.672391 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-42e53c4b-fd34-45a5-9cf0-0a72e4644a42 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:27.672824 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-42e53c4b-fd34-45a5-9cf0-0a72e4644a42 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:27.673508 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-42e53c4b-fd34-45a5-9cf0-0a72e4644a42 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:27.673959 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-42e53c4b-fd34-45a5-9cf0-0a72e4644a42 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:27.674380 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-42e53c4b-fd34-45a5-9cf0-0a72e4644a42 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:27.803175 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-42e53c4b-fd34-45a5-9cf0-0a72e4644a42 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:27.811615 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-42e53c4b-fd34-45a5-9cf0-0a72e4644a42 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:27.813076 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-42e53c4b-fd34-45a5-9cf0-0a72e4644a42 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:27.814258 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-42e53c4b-fd34-45a5-9cf0-0a72e4644a42 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.154073 Aug 29 19:06:27.814829 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 260/537] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:27 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:06:28.837497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-93417ab3-c8c2-46c2-854c-afe93909e111 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:28.838179 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-93417ab3-c8c2-46c2-854c-afe93909e111 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:28.840592 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=51 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:06:28.845788 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93417ab3-c8c2-46c2-854c-afe93909e111 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:28.846264 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93417ab3-c8c2-46c2-854c-afe93909e111 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:28.846693 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93417ab3-c8c2-46c2-854c-afe93909e111 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:28.847396 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93417ab3-c8c2-46c2-854c-afe93909e111 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:28.847848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93417ab3-c8c2-46c2-854c-afe93909e111 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:28.848265 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93417ab3-c8c2-46c2-854c-afe93909e111 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:28.979183 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-93417ab3-c8c2-46c2-854c-afe93909e111 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:28.987245 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-93417ab3-c8c2-46c2-854c-afe93909e111 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:28.989159 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-93417ab3-c8c2-46c2-854c-afe93909e111 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:28.990293 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-93417ab3-c8c2-46c2-854c-afe93909e111 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.156842 Aug 29 19:06:28.990836 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 278/538] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:28 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:30.013378 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d90f7274-2639-41db-a377-c54cc156c364 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:30.013986 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d90f7274-2639-41db-a377-c54cc156c364 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:30.016431 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=51 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:06:30.021715 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d90f7274-2639-41db-a377-c54cc156c364 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:30.022188 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d90f7274-2639-41db-a377-c54cc156c364 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:30.022615 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d90f7274-2639-41db-a377-c54cc156c364 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:30.023319 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d90f7274-2639-41db-a377-c54cc156c364 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:30.023766 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d90f7274-2639-41db-a377-c54cc156c364 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:30.024188 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d90f7274-2639-41db-a377-c54cc156c364 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:30.151637 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d90f7274-2639-41db-a377-c54cc156c364 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:30.159588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d90f7274-2639-41db-a377-c54cc156c364 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:30.161539 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d90f7274-2639-41db-a377-c54cc156c364 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:30.162685 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d90f7274-2639-41db-a377-c54cc156c364 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.153157 Aug 29 19:06:30.163288 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 261/539] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:30 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:31.185831 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-982520a9-4355-4dd7-bc4d-fe5d01449b0e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:31.186410 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-982520a9-4355-4dd7-bc4d-fe5d01449b0e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:31.192738 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-982520a9-4355-4dd7-bc4d-fe5d01449b0e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:31.193215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-982520a9-4355-4dd7-bc4d-fe5d01449b0e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:31.193644 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-982520a9-4355-4dd7-bc4d-fe5d01449b0e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:31.194319 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-982520a9-4355-4dd7-bc4d-fe5d01449b0e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:31.195085 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-982520a9-4355-4dd7-bc4d-fe5d01449b0e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:31.195513 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-982520a9-4355-4dd7-bc4d-fe5d01449b0e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:31.330291 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-982520a9-4355-4dd7-bc4d-fe5d01449b0e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:31.339270 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-982520a9-4355-4dd7-bc4d-fe5d01449b0e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:31.340855 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-982520a9-4355-4dd7-bc4d-fe5d01449b0e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:31.341999 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-982520a9-4355-4dd7-bc4d-fe5d01449b0e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1744 microversion: 2.20 time: 0.160126 Aug 29 19:06:31.342543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 279/540] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:31 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:32.365441 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4db226ef-658b-464e-95c7-d2ba7a270ee7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:32.366066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4db226ef-658b-464e-95c7-d2ba7a270ee7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:32.372698 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4db226ef-658b-464e-95c7-d2ba7a270ee7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:32.373174 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4db226ef-658b-464e-95c7-d2ba7a270ee7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:32.373602 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4db226ef-658b-464e-95c7-d2ba7a270ee7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:32.374284 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4db226ef-658b-464e-95c7-d2ba7a270ee7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:32.374727 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4db226ef-658b-464e-95c7-d2ba7a270ee7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:32.375174 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4db226ef-658b-464e-95c7-d2ba7a270ee7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:32.437152 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6096304e-e30c-4b92-9f81-78cd2b2aea55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:32.437676 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6096304e-e30c-4b92-9f81-78cd2b2aea55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:32.444997 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6096304e-e30c-4b92-9f81-78cd2b2aea55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:32.445481 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6096304e-e30c-4b92-9f81-78cd2b2aea55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:32.445916 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6096304e-e30c-4b92-9f81-78cd2b2aea55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:32.446608 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6096304e-e30c-4b92-9f81-78cd2b2aea55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:32.447093 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6096304e-e30c-4b92-9f81-78cd2b2aea55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:32.447517 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6096304e-e30c-4b92-9f81-78cd2b2aea55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:32.507485 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4db226ef-658b-464e-95c7-d2ba7a270ee7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:32.515667 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4db226ef-658b-464e-95c7-d2ba7a270ee7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:32.517087 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4db226ef-658b-464e-95c7-d2ba7a270ee7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:32.518226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4db226ef-658b-464e-95c7-d2ba7a270ee7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1744 microversion: 2.20 time: 0.156794 Aug 29 19:06:32.518777 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 262/541] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:32 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:32.576546 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-6096304e-e30c-4b92-9f81-78cd2b2aea55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lazy-loading 'services' on Instance uuid 1134fbcb-be0a-424d-8e20-abf975209cb1 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:06:32.696298 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6096304e-e30c-4b92-9f81-78cd2b2aea55 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "DELETE /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1/os-volume_attachments/8f11a63e-2dee-4402-b43c-09eac6d28ca2" status: 202 len: 0 microversion: 2.1 time: 0.262364 Aug 29 19:06:32.697026 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 280/542] 10.222.0.86 () {58 vars in 1416 bytes} [Mon Aug 29 19:06:32 2022] DELETE /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1/os-volume_attachments/8f11a63e-2dee-4402-b43c-09eac6d28ca2 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:06:33.542338 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-25bee17d-5a07-4c90-98ab-949c66f8f945 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:33.542943 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-25bee17d-5a07-4c90-98ab-949c66f8f945 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:33.550087 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25bee17d-5a07-4c90-98ab-949c66f8f945 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:33.550380 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25bee17d-5a07-4c90-98ab-949c66f8f945 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:33.550817 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25bee17d-5a07-4c90-98ab-949c66f8f945 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:33.552029 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25bee17d-5a07-4c90-98ab-949c66f8f945 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:33.552463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25bee17d-5a07-4c90-98ab-949c66f8f945 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:33.552888 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25bee17d-5a07-4c90-98ab-949c66f8f945 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:33.686337 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-25bee17d-5a07-4c90-98ab-949c66f8f945 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:33.694406 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-25bee17d-5a07-4c90-98ab-949c66f8f945 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:33.696142 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-25bee17d-5a07-4c90-98ab-949c66f8f945 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:33.697288 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-25bee17d-5a07-4c90-98ab-949c66f8f945 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1744 microversion: 2.20 time: 0.158978 Aug 29 19:06:33.697846 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 263/543] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:33 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:34.721659 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ad18af28-61ed-464d-85a4-9a4b4aec2e55 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:34.722347 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ad18af28-61ed-464d-85a4-9a4b4aec2e55 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:34.728554 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad18af28-61ed-464d-85a4-9a4b4aec2e55 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:34.729033 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad18af28-61ed-464d-85a4-9a4b4aec2e55 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:34.729464 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad18af28-61ed-464d-85a4-9a4b4aec2e55 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:34.730150 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad18af28-61ed-464d-85a4-9a4b4aec2e55 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:34.730599 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad18af28-61ed-464d-85a4-9a4b4aec2e55 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:34.731046 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad18af28-61ed-464d-85a4-9a4b4aec2e55 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:34.862342 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ad18af28-61ed-464d-85a4-9a4b4aec2e55 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:34.870356 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ad18af28-61ed-464d-85a4-9a4b4aec2e55 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:34.871833 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ad18af28-61ed-464d-85a4-9a4b4aec2e55 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:34.872990 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ad18af28-61ed-464d-85a4-9a4b4aec2e55 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1744 microversion: 2.20 time: 0.156160 Aug 29 19:06:34.873543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 281/544] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:34 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:34.877562 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9547716e-720c-4fef-bd56-7f6f4e2a9501 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:34.878082 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9547716e-720c-4fef-bd56-7f6f4e2a9501 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:34.885167 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9547716e-720c-4fef-bd56-7f6f4e2a9501 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:34.885643 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9547716e-720c-4fef-bd56-7f6f4e2a9501 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:34.886067 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9547716e-720c-4fef-bd56-7f6f4e2a9501 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:34.886763 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9547716e-720c-4fef-bd56-7f6f4e2a9501 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:34.888145 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9547716e-720c-4fef-bd56-7f6f4e2a9501 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:34.888786 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9547716e-720c-4fef-bd56-7f6f4e2a9501 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:34.914006 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9547716e-720c-4fef-bd56-7f6f4e2a9501 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:06:34.990320 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9547716e-720c-4fef-bd56-7f6f4e2a9501 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "DELETE /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 204 len: 0 microversion: 2.1 time: 0.116227 Aug 29 19:06:34.990823 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 264/545] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:06:34 2022] DELETE /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:06:34.998941 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2a1027ee-4d45-4fce-a465-3614807ae93c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:34.999581 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2a1027ee-4d45-4fce-a465-3614807ae93c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:35.006026 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a1027ee-4d45-4fce-a465-3614807ae93c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:35.006509 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a1027ee-4d45-4fce-a465-3614807ae93c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:35.006979 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a1027ee-4d45-4fce-a465-3614807ae93c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:35.007684 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a1027ee-4d45-4fce-a465-3614807ae93c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:35.008138 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a1027ee-4d45-4fce-a465-3614807ae93c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:35.008559 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a1027ee-4d45-4fce-a465-3614807ae93c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:35.133815 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2a1027ee-4d45-4fce-a465-3614807ae93c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:35.137308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:06:35.142461 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2a1027ee-4d45-4fce-a465-3614807ae93c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1513 microversion: 2.1 time: 0.147284 Aug 29 19:06:35.143038 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 282/546] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:34 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:35.896607 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-889299dc-e482-45af-9fc2-49517ff61aa6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:35.897228 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-889299dc-e482-45af-9fc2-49517ff61aa6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:35.903664 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-889299dc-e482-45af-9fc2-49517ff61aa6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:35.904148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-889299dc-e482-45af-9fc2-49517ff61aa6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:35.904580 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-889299dc-e482-45af-9fc2-49517ff61aa6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:35.905261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-889299dc-e482-45af-9fc2-49517ff61aa6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:35.905721 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-889299dc-e482-45af-9fc2-49517ff61aa6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:35.906136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-889299dc-e482-45af-9fc2-49517ff61aa6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:35.910067 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:06:36.040783 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-889299dc-e482-45af-9fc2-49517ff61aa6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:36.049071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-889299dc-e482-45af-9fc2-49517ff61aa6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:36.050537 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-889299dc-e482-45af-9fc2-49517ff61aa6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:36.051784 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-889299dc-e482-45af-9fc2-49517ff61aa6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1744 microversion: 2.20 time: 0.160089 Aug 29 19:06:36.052341 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 265/547] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:35 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:06:36.164665 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9ade9b15-8301-4b4c-8593-414246de9db7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:36.165276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9ade9b15-8301-4b4c-8593-414246de9db7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:36.172995 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ade9b15-8301-4b4c-8593-414246de9db7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:36.173484 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ade9b15-8301-4b4c-8593-414246de9db7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:36.173918 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ade9b15-8301-4b4c-8593-414246de9db7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:36.174616 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ade9b15-8301-4b4c-8593-414246de9db7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:36.175096 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ade9b15-8301-4b4c-8593-414246de9db7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:36.175525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ade9b15-8301-4b4c-8593-414246de9db7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:36.193687 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-446d8ee1-1512-4db4-a511-8a64471802dd req-95a42e04-eba1-4c09-9278-e6ecae9ce7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55705ba3-2981-43e1-80e0-29995ee472a9", "name": "network-vif-plugged", "status": "completed", "tag": "e7223967-a4dc-4ee2-8b85-82a153b42231"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:06:36.205894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-446d8ee1-1512-4db4-a511-8a64471802dd req-95a42e04-eba1-4c09-9278-e6ecae9ce7f7 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:36.206941 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-446d8ee1-1512-4db4-a511-8a64471802dd req-95a42e04-eba1-4c09-9278-e6ecae9ce7f7 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:36.207669 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-446d8ee1-1512-4db4-a511-8a64471802dd req-95a42e04-eba1-4c09-9278-e6ecae9ce7f7 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:36.219237 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-446d8ee1-1512-4db4-a511-8a64471802dd req-95a42e04-eba1-4c09-9278-e6ecae9ce7f7 service nova] Creating event network-vif-plugged:e7223967-a4dc-4ee2-8b85-82a153b42231 for instance 55705ba3-2981-43e1-80e0-29995ee472a9 on hv-cinder-85083 Aug 29 19:06:36.225474 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-446d8ee1-1512-4db4-a511-8a64471802dd req-95a42e04-eba1-4c09-9278-e6ecae9ce7f7 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035377 Aug 29 19:06:36.226069 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 266/548] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:06:36.311470 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9ade9b15-8301-4b4c-8593-414246de9db7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:36.319214 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9ade9b15-8301-4b4c-8593-414246de9db7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1513 microversion: 2.1 time: 0.158932 Aug 29 19:06:36.320023 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 283/549] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:36 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:37.075968 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9655568b-6c99-4036-ac38-c0097f892243 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:37.076661 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9655568b-6c99-4036-ac38-c0097f892243 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:37.084807 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9655568b-6c99-4036-ac38-c0097f892243 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:37.085294 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9655568b-6c99-4036-ac38-c0097f892243 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:37.085736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9655568b-6c99-4036-ac38-c0097f892243 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:37.086434 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9655568b-6c99-4036-ac38-c0097f892243 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:37.086887 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9655568b-6c99-4036-ac38-c0097f892243 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:37.087340 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9655568b-6c99-4036-ac38-c0097f892243 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:37.340341 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c81e332c-40d7-42f0-9afd-b02901b23589 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:37.340942 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c81e332c-40d7-42f0-9afd-b02901b23589 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:37.347342 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c81e332c-40d7-42f0-9afd-b02901b23589 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:37.347821 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c81e332c-40d7-42f0-9afd-b02901b23589 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:37.348251 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c81e332c-40d7-42f0-9afd-b02901b23589 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:37.348945 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c81e332c-40d7-42f0-9afd-b02901b23589 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:37.349393 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c81e332c-40d7-42f0-9afd-b02901b23589 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:37.349810 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c81e332c-40d7-42f0-9afd-b02901b23589 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:37.377570 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9655568b-6c99-4036-ac38-c0097f892243 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:37.393892 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9655568b-6c99-4036-ac38-c0097f892243 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:37.395564 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9655568b-6c99-4036-ac38-c0097f892243 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:37.396721 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9655568b-6c99-4036-ac38-c0097f892243 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1744 microversion: 2.20 time: 0.325836 Aug 29 19:06:37.397474 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 267/550] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:37 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1744 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:37.623898 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c81e332c-40d7-42f0-9afd-b02901b23589 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:37.632297 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c81e332c-40d7-42f0-9afd-b02901b23589 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1513 microversion: 2.1 time: 0.295789 Aug 29 19:06:37.633249 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 284/551] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:37 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1513 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:06:37.997287 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-d465fbba-6ba8-4a87-a227-dd06b118d077 req-1113bb83-d032-48ed-b458-b0dd3dfe7299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1134fbcb-be0a-424d-8e20-abf975209cb1", "name": "network-vif-deleted", "tag": "71085a76-18e8-4947-99d8-a14d676237aa"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:06:38.007128 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-d465fbba-6ba8-4a87-a227-dd06b118d077 req-1113bb83-d032-48ed-b458-b0dd3dfe7299 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:38.007601 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-d465fbba-6ba8-4a87-a227-dd06b118d077 req-1113bb83-d032-48ed-b458-b0dd3dfe7299 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:38.008081 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-d465fbba-6ba8-4a87-a227-dd06b118d077 req-1113bb83-d032-48ed-b458-b0dd3dfe7299 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:38.018813 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-d465fbba-6ba8-4a87-a227-dd06b118d077 req-1113bb83-d032-48ed-b458-b0dd3dfe7299 service nova] Creating event network-vif-deleted:71085a76-18e8-4947-99d8-a14d676237aa for instance 1134fbcb-be0a-424d-8e20-abf975209cb1 on hv-cinder-85083 Aug 29 19:06:38.024136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-d465fbba-6ba8-4a87-a227-dd06b118d077 req-1113bb83-d032-48ed-b458-b0dd3dfe7299 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030471 Aug 29 19:06:38.024699 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 268/552] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:06:38.420264 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3e842d22-1f1d-4455-afd5-e9a008132144 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:38.420881 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3e842d22-1f1d-4455-afd5-e9a008132144 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:38.427858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e842d22-1f1d-4455-afd5-e9a008132144 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:38.428344 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e842d22-1f1d-4455-afd5-e9a008132144 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:38.428829 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e842d22-1f1d-4455-afd5-e9a008132144 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:38.429558 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e842d22-1f1d-4455-afd5-e9a008132144 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:38.430035 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e842d22-1f1d-4455-afd5-e9a008132144 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:38.430442 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e842d22-1f1d-4455-afd5-e9a008132144 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:38.569421 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3e842d22-1f1d-4455-afd5-e9a008132144 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:38.577702 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3e842d22-1f1d-4455-afd5-e9a008132144 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:38.579166 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3e842d22-1f1d-4455-afd5-e9a008132144 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:38.580298 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3e842d22-1f1d-4455-afd5-e9a008132144 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1744 microversion: 2.20 time: 0.164146 Aug 29 19:06:38.580849 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 285/553] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:38 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:38.654882 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8b777a50-42bb-41be-a840-9d9fa6f1c9a0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:38.655636 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8b777a50-42bb-41be-a840-9d9fa6f1c9a0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:38.661702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8b777a50-42bb-41be-a840-9d9fa6f1c9a0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:38.662174 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8b777a50-42bb-41be-a840-9d9fa6f1c9a0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:38.662601 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8b777a50-42bb-41be-a840-9d9fa6f1c9a0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:38.663301 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8b777a50-42bb-41be-a840-9d9fa6f1c9a0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:38.663750 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8b777a50-42bb-41be-a840-9d9fa6f1c9a0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:38.664325 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8b777a50-42bb-41be-a840-9d9fa6f1c9a0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:38.695982 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8b777a50-42bb-41be-a840-9d9fa6f1c9a0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:38.696457 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8b777a50-42bb-41be-a840-9d9fa6f1c9a0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:38.696882 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8b777a50-42bb-41be-a840-9d9fa6f1c9a0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:38.697323 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-8b777a50-42bb-41be-a840-9d9fa6f1c9a0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lazy-loading 'fault' on Instance uuid 1134fbcb-be0a-424d-8e20-abf975209cb1 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:06:38.738136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8b777a50-42bb-41be-a840-9d9fa6f1c9a0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:38.746423 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8b777a50-42bb-41be-a840-9d9fa6f1c9a0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1308 microversion: 2.1 time: 0.096092 Aug 29 19:06:38.746981 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 269/554] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:38 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:06:39.603521 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ec0a6582-d5ba-41e7-a535-a6f85de2d416 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:39.604136 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ec0a6582-d5ba-41e7-a535-a6f85de2d416 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:39.610698 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec0a6582-d5ba-41e7-a535-a6f85de2d416 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:39.611215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec0a6582-d5ba-41e7-a535-a6f85de2d416 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:39.611844 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec0a6582-d5ba-41e7-a535-a6f85de2d416 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:39.612710 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec0a6582-d5ba-41e7-a535-a6f85de2d416 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:39.613910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec0a6582-d5ba-41e7-a535-a6f85de2d416 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:39.614495 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec0a6582-d5ba-41e7-a535-a6f85de2d416 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:39.770495 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-57bd80b7-cd82-4c15-9a0c-1c2f0876c72f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:39.772833 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-57bd80b7-cd82-4c15-9a0c-1c2f0876c72f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:39.780310 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57bd80b7-cd82-4c15-9a0c-1c2f0876c72f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:39.781076 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57bd80b7-cd82-4c15-9a0c-1c2f0876c72f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:39.781677 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57bd80b7-cd82-4c15-9a0c-1c2f0876c72f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:39.782510 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ec0a6582-d5ba-41e7-a535-a6f85de2d416 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:39.782856 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57bd80b7-cd82-4c15-9a0c-1c2f0876c72f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:39.783484 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57bd80b7-cd82-4c15-9a0c-1c2f0876c72f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:39.784207 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57bd80b7-cd82-4c15-9a0c-1c2f0876c72f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:39.794636 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ec0a6582-d5ba-41e7-a535-a6f85de2d416 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:39.796276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ec0a6582-d5ba-41e7-a535-a6f85de2d416 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:39.800725 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ec0a6582-d5ba-41e7-a535-a6f85de2d416 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1739 microversion: 2.20 time: 0.201086 Aug 29 19:06:39.803215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 286/555] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:39 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:39.840186 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57bd80b7-cd82-4c15-9a0c-1c2f0876c72f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:39.841050 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57bd80b7-cd82-4c15-9a0c-1c2f0876c72f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:39.841848 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57bd80b7-cd82-4c15-9a0c-1c2f0876c72f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:39.842797 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-57bd80b7-cd82-4c15-9a0c-1c2f0876c72f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lazy-loading 'fault' on Instance uuid 1134fbcb-be0a-424d-8e20-abf975209cb1 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:06:39.898396 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-57bd80b7-cd82-4c15-9a0c-1c2f0876c72f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:39.907464 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-57bd80b7-cd82-4c15-9a0c-1c2f0876c72f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 200 len: 1308 microversion: 2.1 time: 0.142415 Aug 29 19:06:39.915239 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 270/556] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:39 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 1308 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:40.824804 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cae8ad40-5d11-4cdd-8639-30e9be9d08aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:40.826121 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cae8ad40-5d11-4cdd-8639-30e9be9d08aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:40.833984 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cae8ad40-5d11-4cdd-8639-30e9be9d08aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:40.834708 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cae8ad40-5d11-4cdd-8639-30e9be9d08aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:40.835344 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cae8ad40-5d11-4cdd-8639-30e9be9d08aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:40.836322 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cae8ad40-5d11-4cdd-8639-30e9be9d08aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:40.836938 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cae8ad40-5d11-4cdd-8639-30e9be9d08aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:40.837358 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cae8ad40-5d11-4cdd-8639-30e9be9d08aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:40.931329 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-af1fde3f-2c12-491b-ad32-e2188b158f87 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:40.932591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-af1fde3f-2c12-491b-ad32-e2188b158f87 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: 1134fbcb-be0a-424d-8e20-abf975209cb1] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:40.939788 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af1fde3f-2c12-491b-ad32-e2188b158f87 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:40.940504 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af1fde3f-2c12-491b-ad32-e2188b158f87 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:40.941163 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af1fde3f-2c12-491b-ad32-e2188b158f87 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:40.942171 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af1fde3f-2c12-491b-ad32-e2188b158f87 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:40.942783 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af1fde3f-2c12-491b-ad32-e2188b158f87 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:40.943387 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af1fde3f-2c12-491b-ad32-e2188b158f87 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:40.965059 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-af1fde3f-2c12-491b-ad32-e2188b158f87 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] HTTP exception thrown: Instance 1134fbcb-be0a-424d-8e20-abf975209cb1 could not be found. Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-af1fde3f-2c12-491b-ad32-e2188b158f87 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Request method failure captured: Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 HTTP/1.1 Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ3EefqZxFsH_ahFuqGL6v_BH8X2FXmx8UPjy5RW0BlVYtEl0fZrDwXUSc6cUr2FrsfNi8rjCQ8pvpY9jfpO3LWkuxh15JG6rfKIxjPdYCMkmCyaSaLcRCwjL78v3MCCBq5SBXqTsfKnlTdZC39mGrxaNzSR7E50S4LBzbp4Ytw7lHQ Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 7918fb7f8aea4f58857307485bc09ec6 Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesSnapshotTestJSON-291539592 Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:06:40.968061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:06:40.969756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7918fb7f8aea4f58857307485bc09ec6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7918fb7f8aea4f58857307485bc09ec6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7918fb7f8aea4f58857307485bc09ec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7918fb7f8aea4f58857307485bc09ec6"}]}] Aug 29 19:06:40.969756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesSnapshotTestJSON-291539592 Aug 29 19:06:40.969756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 7918fb7f8aea4f58857307485bc09ec6 Aug 29 19:06:40.969756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-291539592 Aug 29 19:06:40.969756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesSnapshotTestJSON-291539592-project Aug 29 19:06:40.969756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:06:40.969756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:06:40.969756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: 98e853439341466dbea3a535ca13d12b Aug 29 19:06:40.969756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesSnapshotTestJSON-291539592-project Aug 29 19:06:40.969756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:06:40.969756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance 1134fbcb-be0a-424d-8e20-abf975209cb1 could not be found. Aug 29 19:06:40.969756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': '1134fbcb-be0a-424d-8e20-abf975209cb1'} Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1134fbcb-be0a-424d-8e20-abf975209cb1 could not be found. Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:06:40.970702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1134fbcb-be0a-424d-8e20-abf975209cb1 could not be found. Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1134fbcb-be0a-424d-8e20-abf975209cb1 could not be found. Aug 29 19:06:40.972256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:06:40.974074 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-af1fde3f-2c12-491b-ad32-e2188b158f87 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Returning 404 to user: Instance 1134fbcb-be0a-424d-8e20-abf975209cb1 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:06:40.974074 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-af1fde3f-2c12-491b-ad32-e2188b158f87 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1" status: 404 len: 111 microversion: 2.1 time: 0.045165 Aug 29 19:06:40.983748 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 271/557] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:40 2022] GET /compute/v2.1/servers/1134fbcb-be0a-424d-8e20-abf975209cb1 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:06:41.004058 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cae8ad40-5d11-4cdd-8639-30e9be9d08aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:41.015405 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cae8ad40-5d11-4cdd-8639-30e9be9d08aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:41.016867 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cae8ad40-5d11-4cdd-8639-30e9be9d08aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:41.018440 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cae8ad40-5d11-4cdd-8639-30e9be9d08aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1739 microversion: 2.20 time: 0.197472 Aug 29 19:06:41.020159 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 287/558] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:40 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:42.044918 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f325d28d-2da0-45cf-a8a7-041ec82bb620 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:42.046155 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f325d28d-2da0-45cf-a8a7-041ec82bb620 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:42.054941 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f325d28d-2da0-45cf-a8a7-041ec82bb620 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:42.055451 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f325d28d-2da0-45cf-a8a7-041ec82bb620 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:42.055880 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f325d28d-2da0-45cf-a8a7-041ec82bb620 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:42.056562 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f325d28d-2da0-45cf-a8a7-041ec82bb620 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:42.057005 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f325d28d-2da0-45cf-a8a7-041ec82bb620 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:42.057425 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f325d28d-2da0-45cf-a8a7-041ec82bb620 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:42.253508 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f325d28d-2da0-45cf-a8a7-041ec82bb620 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:42.263568 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f325d28d-2da0-45cf-a8a7-041ec82bb620 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:42.266623 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f325d28d-2da0-45cf-a8a7-041ec82bb620 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:42.268310 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f325d28d-2da0-45cf-a8a7-041ec82bb620 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1739 microversion: 2.20 time: 0.230063 Aug 29 19:06:42.283276 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 272/559] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:42 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:43.291524 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0c672f29-39f9-4dc8-ba7f-1af1c0a8e96c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:43.292132 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0c672f29-39f9-4dc8-ba7f-1af1c0a8e96c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:43.298580 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c672f29-39f9-4dc8-ba7f-1af1c0a8e96c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:43.299098 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c672f29-39f9-4dc8-ba7f-1af1c0a8e96c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:43.299534 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c672f29-39f9-4dc8-ba7f-1af1c0a8e96c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:43.300215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c672f29-39f9-4dc8-ba7f-1af1c0a8e96c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:43.301235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c672f29-39f9-4dc8-ba7f-1af1c0a8e96c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:43.301656 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c672f29-39f9-4dc8-ba7f-1af1c0a8e96c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:43.437148 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0c672f29-39f9-4dc8-ba7f-1af1c0a8e96c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:43.446261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0c672f29-39f9-4dc8-ba7f-1af1c0a8e96c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:43.447729 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0c672f29-39f9-4dc8-ba7f-1af1c0a8e96c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:43.448888 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0c672f29-39f9-4dc8-ba7f-1af1c0a8e96c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1739 microversion: 2.20 time: 0.161171 Aug 29 19:06:43.449447 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 288/560] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:43 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:44.470776 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-06832584-4df6-426b-8395-5fc16b7521ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:44.472289 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-06832584-4df6-426b-8395-5fc16b7521ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:44.479547 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06832584-4df6-426b-8395-5fc16b7521ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:44.480221 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06832584-4df6-426b-8395-5fc16b7521ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:44.480820 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06832584-4df6-426b-8395-5fc16b7521ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:44.481704 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06832584-4df6-426b-8395-5fc16b7521ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:44.482307 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06832584-4df6-426b-8395-5fc16b7521ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:44.482725 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06832584-4df6-426b-8395-5fc16b7521ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:44.616582 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-06832584-4df6-426b-8395-5fc16b7521ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:44.632838 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-06832584-4df6-426b-8395-5fc16b7521ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:44.635840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-06832584-4df6-426b-8395-5fc16b7521ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:44.637436 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-06832584-4df6-426b-8395-5fc16b7521ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1739 microversion: 2.20 time: 0.170464 Aug 29 19:06:44.638062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 273/561] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:44 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:45.669976 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d86f510c-7b63-4a4f-a181-22dfbcecb41e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:45.670519 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d86f510c-7b63-4a4f-a181-22dfbcecb41e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:45.677735 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d86f510c-7b63-4a4f-a181-22dfbcecb41e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:45.678433 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d86f510c-7b63-4a4f-a181-22dfbcecb41e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:45.679076 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d86f510c-7b63-4a4f-a181-22dfbcecb41e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:45.680053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d86f510c-7b63-4a4f-a181-22dfbcecb41e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:45.680518 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d86f510c-7b63-4a4f-a181-22dfbcecb41e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:45.680934 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d86f510c-7b63-4a4f-a181-22dfbcecb41e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:45.838737 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d86f510c-7b63-4a4f-a181-22dfbcecb41e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:45.853471 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d86f510c-7b63-4a4f-a181-22dfbcecb41e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:45.856247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d86f510c-7b63-4a4f-a181-22dfbcecb41e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:45.856247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d86f510c-7b63-4a4f-a181-22dfbcecb41e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1739 microversion: 2.20 time: 0.198737 Aug 29 19:06:45.856854 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 289/562] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:45 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:46.879617 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-11988251-ec95-4397-8125-58ab729a84aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:46.881039 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-11988251-ec95-4397-8125-58ab729a84aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:46.888063 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11988251-ec95-4397-8125-58ab729a84aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:46.888785 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11988251-ec95-4397-8125-58ab729a84aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:46.889316 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11988251-ec95-4397-8125-58ab729a84aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:46.890106 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11988251-ec95-4397-8125-58ab729a84aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:46.890656 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11988251-ec95-4397-8125-58ab729a84aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:46.891206 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11988251-ec95-4397-8125-58ab729a84aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:47.028461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-11988251-ec95-4397-8125-58ab729a84aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:47.036978 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-11988251-ec95-4397-8125-58ab729a84aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:47.039107 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-11988251-ec95-4397-8125-58ab729a84aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:47.040839 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-11988251-ec95-4397-8125-58ab729a84aa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1739 microversion: 2.20 time: 0.165590 Aug 29 19:06:47.041729 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 274/563] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:46 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:48.193011 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-db97bc45-48cb-4754-b726-3081f314ea40 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:48.193625 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-db97bc45-48cb-4754-b726-3081f314ea40 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:48.200307 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db97bc45-48cb-4754-b726-3081f314ea40 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:48.201135 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db97bc45-48cb-4754-b726-3081f314ea40 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:48.201767 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db97bc45-48cb-4754-b726-3081f314ea40 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:48.202455 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db97bc45-48cb-4754-b726-3081f314ea40 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:48.203137 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db97bc45-48cb-4754-b726-3081f314ea40 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:48.203555 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db97bc45-48cb-4754-b726-3081f314ea40 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:48.360023 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-db97bc45-48cb-4754-b726-3081f314ea40 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:48.371325 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-db97bc45-48cb-4754-b726-3081f314ea40 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:48.373018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-db97bc45-48cb-4754-b726-3081f314ea40 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:48.374362 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-db97bc45-48cb-4754-b726-3081f314ea40 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1739 microversion: 2.20 time: 0.313830 Aug 29 19:06:48.374905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 290/564] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:48 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:49.398390 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5fb2f393-65e2-4433-a462-b05574143862 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:49.399658 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5fb2f393-65e2-4433-a462-b05574143862 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:49.405948 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5fb2f393-65e2-4433-a462-b05574143862 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:49.406704 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5fb2f393-65e2-4433-a462-b05574143862 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:49.407373 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5fb2f393-65e2-4433-a462-b05574143862 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:49.408267 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5fb2f393-65e2-4433-a462-b05574143862 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:49.408915 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5fb2f393-65e2-4433-a462-b05574143862 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:49.409538 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5fb2f393-65e2-4433-a462-b05574143862 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:49.492368 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 19:06:49.492781 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Mon Aug 29 19:06:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 (ip 10.222.0.86) !!! Aug 29 19:06:49.581281 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5fb2f393-65e2-4433-a462-b05574143862 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:49.590472 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5fb2f393-65e2-4433-a462-b05574143862 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:49.592270 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5fb2f393-65e2-4433-a462-b05574143862 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:49.593660 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5fb2f393-65e2-4433-a462-b05574143862 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1739 microversion: 2.20 time: 0.199782 Aug 29 19:06:49.594309 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 275/565] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:49 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:50.616895 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c63657eb-0523-4897-82ae-c7f50c7256be tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:50.617501 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c63657eb-0523-4897-82ae-c7f50c7256be tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:50.623874 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c63657eb-0523-4897-82ae-c7f50c7256be tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:50.624357 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c63657eb-0523-4897-82ae-c7f50c7256be tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:50.624790 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c63657eb-0523-4897-82ae-c7f50c7256be tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:50.625474 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c63657eb-0523-4897-82ae-c7f50c7256be tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:50.625929 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c63657eb-0523-4897-82ae-c7f50c7256be tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:50.626350 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c63657eb-0523-4897-82ae-c7f50c7256be tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:50.753020 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c63657eb-0523-4897-82ae-c7f50c7256be tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:50.761018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c63657eb-0523-4897-82ae-c7f50c7256be tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:50.762452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c63657eb-0523-4897-82ae-c7f50c7256be tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:50.763614 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c63657eb-0523-4897-82ae-c7f50c7256be tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1739 microversion: 2.20 time: 0.150564 Aug 29 19:06:50.764176 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 291/566] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:50 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:51.786853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2513a67f-6a13-41dc-ad0f-aa17a326ef73 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:51.787520 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2513a67f-6a13-41dc-ad0f-aa17a326ef73 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:51.794204 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2513a67f-6a13-41dc-ad0f-aa17a326ef73 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:51.794682 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2513a67f-6a13-41dc-ad0f-aa17a326ef73 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:51.795158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2513a67f-6a13-41dc-ad0f-aa17a326ef73 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:51.795850 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2513a67f-6a13-41dc-ad0f-aa17a326ef73 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:51.796302 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2513a67f-6a13-41dc-ad0f-aa17a326ef73 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:51.796725 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2513a67f-6a13-41dc-ad0f-aa17a326ef73 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:51.928610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2513a67f-6a13-41dc-ad0f-aa17a326ef73 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:51.936746 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2513a67f-6a13-41dc-ad0f-aa17a326ef73 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:51.938163 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2513a67f-6a13-41dc-ad0f-aa17a326ef73 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:51.939337 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2513a67f-6a13-41dc-ad0f-aa17a326ef73 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1739 microversion: 2.20 time: 0.157136 Aug 29 19:06:51.939880 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 276/567] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:51 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:52.963732 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-af9e4f01-a1b6-4570-8a4c-6660d10428e1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:52.964342 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-af9e4f01-a1b6-4570-8a4c-6660d10428e1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:52.970624 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-af9e4f01-a1b6-4570-8a4c-6660d10428e1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:52.971131 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-af9e4f01-a1b6-4570-8a4c-6660d10428e1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:52.971561 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-af9e4f01-a1b6-4570-8a4c-6660d10428e1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:52.972238 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-af9e4f01-a1b6-4570-8a4c-6660d10428e1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:52.973346 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-af9e4f01-a1b6-4570-8a4c-6660d10428e1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:52.973762 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-af9e4f01-a1b6-4570-8a4c-6660d10428e1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:53.108795 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-af9e4f01-a1b6-4570-8a4c-6660d10428e1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:53.117262 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-af9e4f01-a1b6-4570-8a4c-6660d10428e1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:53.118692 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-af9e4f01-a1b6-4570-8a4c-6660d10428e1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:53.119862 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-af9e4f01-a1b6-4570-8a4c-6660d10428e1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1739 microversion: 2.20 time: 0.160191 Aug 29 19:06:53.120421 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 292/568] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:52 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:54.088117 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-954036591", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452", "networks": [{"uuid": "8cb6cbd2-2df4-4030-a2ff-e7d302b28d1a"}]}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:06:54.142987 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] validate_networks() for [('8cb6cbd2-2df4-4030-a2ff-e7d302b28d1a', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:06:54.143169 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e07e7c2e-41f1-42d1-9197-2bf6b5a7229d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:54.143752 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e07e7c2e-41f1-42d1-9197-2bf6b5a7229d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:54.152681 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e07e7c2e-41f1-42d1-9197-2bf6b5a7229d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:54.153175 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e07e7c2e-41f1-42d1-9197-2bf6b5a7229d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:54.153606 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e07e7c2e-41f1-42d1-9197-2bf6b5a7229d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:54.154307 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e07e7c2e-41f1-42d1-9197-2bf6b5a7229d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:54.154756 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e07e7c2e-41f1-42d1-9197-2bf6b5a7229d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:54.155205 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e07e7c2e-41f1-42d1-9197-2bf6b5a7229d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:54.347944 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e07e7c2e-41f1-42d1-9197-2bf6b5a7229d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:54.357097 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e07e7c2e-41f1-42d1-9197-2bf6b5a7229d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:54.358537 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e07e7c2e-41f1-42d1-9197-2bf6b5a7229d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:54.359729 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e07e7c2e-41f1-42d1-9197-2bf6b5a7229d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1739 microversion: 2.20 time: 0.220421 Aug 29 19:06:54.360284 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 293/569] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:54 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:54.566050 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:06:54.567104 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:06:54.567646 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:06:54.568061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:06:54.568467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:06:54.577695 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:54.578176 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:54.578607 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:54.579355 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:54.579810 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:54.580297 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:54.596901 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Getting quotas for project 7918fb7f8aea4f58857307485bc09ec6. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:06:54.600894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Getting quotas for user 98e853439341466dbea3a535ca13d12b and project 7918fb7f8aea4f58857307485bc09ec6. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:06:54.611804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:06:54.614577 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:06:54.662016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ad4aa072-dcd3-4ca9-9342-9d006fd53133 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577751 Aug 29 19:06:54.662830 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 277/570] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:06:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 19:06:54.673428 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-aa37516c-32df-425b-958f-c35b03a33561 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:54.674041 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-aa37516c-32df-425b-958f-c35b03a33561 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:54.750088 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-aa37516c-32df-425b-958f-c35b03a33561 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:54.758545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-aa37516c-32df-425b-958f-c35b03a33561 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1218 microversion: 2.1 time: 0.088842 Aug 29 19:06:54.759541 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 294/571] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:54 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:55.384547 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a7daceaa-3771-46db-a234-b9f3a7467f2f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:55.385130 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a7daceaa-3771-46db-a234-b9f3a7467f2f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:55.391949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a7daceaa-3771-46db-a234-b9f3a7467f2f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:55.392649 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a7daceaa-3771-46db-a234-b9f3a7467f2f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:55.393258 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a7daceaa-3771-46db-a234-b9f3a7467f2f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:55.394178 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a7daceaa-3771-46db-a234-b9f3a7467f2f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:55.395303 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a7daceaa-3771-46db-a234-b9f3a7467f2f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:55.395896 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a7daceaa-3771-46db-a234-b9f3a7467f2f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:55.522099 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a7daceaa-3771-46db-a234-b9f3a7467f2f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:55.530173 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a7daceaa-3771-46db-a234-b9f3a7467f2f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:55.531667 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a7daceaa-3771-46db-a234-b9f3a7467f2f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:55.532820 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a7daceaa-3771-46db-a234-b9f3a7467f2f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1721 microversion: 2.20 time: 0.153429 Aug 29 19:06:55.533370 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 278/572] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:55 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:55.778275 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7e0c38f4-9fda-439e-a505-ad68eb7fb493 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:55.778917 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7e0c38f4-9fda-439e-a505-ad68eb7fb493 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:55.781215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 19:06:55.781363 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Mon Aug 29 19:06:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e (ip 10.222.0.86) !!! Aug 29 19:06:55.788708 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e0c38f4-9fda-439e-a505-ad68eb7fb493 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:55.789196 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e0c38f4-9fda-439e-a505-ad68eb7fb493 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:55.789636 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e0c38f4-9fda-439e-a505-ad68eb7fb493 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:55.790325 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e0c38f4-9fda-439e-a505-ad68eb7fb493 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:55.790782 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e0c38f4-9fda-439e-a505-ad68eb7fb493 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:55.791244 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e0c38f4-9fda-439e-a505-ad68eb7fb493 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:55.854461 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7e0c38f4-9fda-439e-a505-ad68eb7fb493 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:55.862025 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7e0c38f4-9fda-439e-a505-ad68eb7fb493 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1222 microversion: 2.1 time: 0.087627 Aug 29 19:06:55.862590 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 295/573] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:55 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:56.561130 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-91411c3d-5c5e-4275-ac24-49c391b70e82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:56.562291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-91411c3d-5c5e-4275-ac24-49c391b70e82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:56.572639 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-91411c3d-5c5e-4275-ac24-49c391b70e82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:56.573114 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-91411c3d-5c5e-4275-ac24-49c391b70e82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:56.573537 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-91411c3d-5c5e-4275-ac24-49c391b70e82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:56.574273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-91411c3d-5c5e-4275-ac24-49c391b70e82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:56.574714 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-91411c3d-5c5e-4275-ac24-49c391b70e82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:56.575160 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-91411c3d-5c5e-4275-ac24-49c391b70e82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:56.704961 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-91411c3d-5c5e-4275-ac24-49c391b70e82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:56.713517 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-91411c3d-5c5e-4275-ac24-49c391b70e82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:56.714983 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-91411c3d-5c5e-4275-ac24-49c391b70e82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:56.716150 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-91411c3d-5c5e-4275-ac24-49c391b70e82 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1721 microversion: 2.20 time: 0.162694 Aug 29 19:06:56.716696 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 279/574] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:56 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:56.882343 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-26916ed6-5af2-4265-aea9-268726b21194 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:56.883190 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-26916ed6-5af2-4265-aea9-268726b21194 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:56.889835 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-26916ed6-5af2-4265-aea9-268726b21194 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:56.890326 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-26916ed6-5af2-4265-aea9-268726b21194 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:56.890760 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-26916ed6-5af2-4265-aea9-268726b21194 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:56.891493 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-26916ed6-5af2-4265-aea9-268726b21194 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:56.891949 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-26916ed6-5af2-4265-aea9-268726b21194 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:56.892364 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-26916ed6-5af2-4265-aea9-268726b21194 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:56.959100 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-26916ed6-5af2-4265-aea9-268726b21194 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:56.967152 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-26916ed6-5af2-4265-aea9-268726b21194 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1270 microversion: 2.1 time: 0.089256 Aug 29 19:06:56.967728 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 296/575] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:56 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:57.739670 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3d907d70-de01-438b-9246-0074274200ee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:57.740300 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3d907d70-de01-438b-9246-0074274200ee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:57.746915 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3d907d70-de01-438b-9246-0074274200ee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:57.747428 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3d907d70-de01-438b-9246-0074274200ee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:57.747858 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3d907d70-de01-438b-9246-0074274200ee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:57.748543 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3d907d70-de01-438b-9246-0074274200ee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:57.748987 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3d907d70-de01-438b-9246-0074274200ee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:57.749404 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3d907d70-de01-438b-9246-0074274200ee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:57.911043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3d907d70-de01-438b-9246-0074274200ee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:57.919366 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3d907d70-de01-438b-9246-0074274200ee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:57.921184 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3d907d70-de01-438b-9246-0074274200ee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:57.922338 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3d907d70-de01-438b-9246-0074274200ee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1724 microversion: 2.20 time: 0.187053 Aug 29 19:06:57.922888 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 280/576] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:57 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:57.945668 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-59f8c928-61e2-441b-b3b2-4f622214e20e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98d1d819-ff35-40b6-bd82-e154750f24d5"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:06:57.948178 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-59f8c928-61e2-441b-b3b2-4f622214e20e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:57.954772 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59f8c928-61e2-441b-b3b2-4f622214e20e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:57.955369 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59f8c928-61e2-441b-b3b2-4f622214e20e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:57.955912 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59f8c928-61e2-441b-b3b2-4f622214e20e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:57.956741 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59f8c928-61e2-441b-b3b2-4f622214e20e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:57.957266 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59f8c928-61e2-441b-b3b2-4f622214e20e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:57.957760 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59f8c928-61e2-441b-b3b2-4f622214e20e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:57.990135 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-11bfe860-30e7-460a-a1cf-151bc0b65835 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:57.990886 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-11bfe860-30e7-460a-a1cf-151bc0b65835 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:57.997449 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11bfe860-30e7-460a-a1cf-151bc0b65835 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:57.998139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11bfe860-30e7-460a-a1cf-151bc0b65835 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:57.999355 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11bfe860-30e7-460a-a1cf-151bc0b65835 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:58.000316 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11bfe860-30e7-460a-a1cf-151bc0b65835 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:58.000935 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11bfe860-30e7-460a-a1cf-151bc0b65835 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:58.002287 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11bfe860-30e7-460a-a1cf-151bc0b65835 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:58.081388 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-11bfe860-30e7-460a-a1cf-151bc0b65835 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:58.090132 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-11bfe860-30e7-460a-a1cf-151bc0b65835 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1276 microversion: 2.1 time: 0.104464 Aug 29 19:06:58.090866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 281/577] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:57 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:06:58.268416 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-84551f9a-7dce-4ac9-b7db-c67ef498a47b req-56342fe1-d0a6-4fb9-b25d-cdea1b6defab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55705ba3-2981-43e1-80e0-29995ee472a9", "name": "network-vif-unplugged", "status": "completed", "tag": "e7223967-a4dc-4ee2-8b85-82a153b42231"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:06:58.279554 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-84551f9a-7dce-4ac9-b7db-c67ef498a47b req-56342fe1-d0a6-4fb9-b25d-cdea1b6defab service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:58.280383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-84551f9a-7dce-4ac9-b7db-c67ef498a47b req-56342fe1-d0a6-4fb9-b25d-cdea1b6defab service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:58.280961 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-84551f9a-7dce-4ac9-b7db-c67ef498a47b req-56342fe1-d0a6-4fb9-b25d-cdea1b6defab service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:58.300603 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.compute.server_external_events [req-84551f9a-7dce-4ac9-b7db-c67ef498a47b req-56342fe1-d0a6-4fb9-b25d-cdea1b6defab service nova] Unable to find a host for instance 55705ba3-2981-43e1-80e0-29995ee472a9. Dropping event network-vif-unplugged {{(pid=120708) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 19:06:58.302084 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-84551f9a-7dce-4ac9-b7db-c67ef498a47b req-56342fe1-d0a6-4fb9-b25d-cdea1b6defab service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037277 Aug 29 19:06:58.303404 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 282/578] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 29 19:06:58.321381 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:06:58.327809 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-59f8c928-61e2-441b-b3b2-4f622214e20e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "POST /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.385066 Aug 29 19:06:58.348145 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 297/579] 10.222.0.86 () {62 vars in 1364 bytes} [Mon Aug 29 19:06:57 2022] POST /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/os-volume_attachments => generated 188 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:06:58.465926 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d99e7b5f-905a-4f87-b065-1743298f3b60 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:06:58.466622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d99e7b5f-905a-4f87-b065-1743298f3b60 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:58.479654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d99e7b5f-905a-4f87-b065-1743298f3b60 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:58.480165 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d99e7b5f-905a-4f87-b065-1743298f3b60 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:58.480603 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d99e7b5f-905a-4f87-b065-1743298f3b60 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:58.481321 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d99e7b5f-905a-4f87-b065-1743298f3b60 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:58.482208 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d99e7b5f-905a-4f87-b065-1743298f3b60 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:58.482208 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d99e7b5f-905a-4f87-b065-1743298f3b60 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:58.578217 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d99e7b5f-905a-4f87-b065-1743298f3b60 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120708) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 19:06:58.625803 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:06:58.653822 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d99e7b5f-905a-4f87-b065-1743298f3b60 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "POST /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/action" status: 202 len: 0 microversion: 2.20 time: 0.192996 Aug 29 19:06:58.654763 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 283/580] 10.222.0.86 () {62 vars in 1319 bytes} [Mon Aug 29 19:06:58 2022] POST /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:06:58.663237 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d8ca06ad-8024-48cf-a159-db6144eb15dd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:58.663868 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d8ca06ad-8024-48cf-a159-db6144eb15dd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:58.672283 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d8ca06ad-8024-48cf-a159-db6144eb15dd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:58.672941 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d8ca06ad-8024-48cf-a159-db6144eb15dd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:58.673216 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d8ca06ad-8024-48cf-a159-db6144eb15dd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:58.674063 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d8ca06ad-8024-48cf-a159-db6144eb15dd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:58.674521 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d8ca06ad-8024-48cf-a159-db6144eb15dd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:58.674945 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d8ca06ad-8024-48cf-a159-db6144eb15dd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:58.823714 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d8ca06ad-8024-48cf-a159-db6144eb15dd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:58.833730 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d8ca06ad-8024-48cf-a159-db6144eb15dd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:58.835216 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d8ca06ad-8024-48cf-a159-db6144eb15dd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:58.836430 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d8ca06ad-8024-48cf-a159-db6144eb15dd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1750 microversion: 2.20 time: 0.177109 Aug 29 19:06:58.839125 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 298/581] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:58 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:06:59.113599 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-97c0b5a8-6622-45d5-b8e2-eaaa1f93d9f7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:59.114737 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-97c0b5a8-6622-45d5-b8e2-eaaa1f93d9f7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:59.121180 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97c0b5a8-6622-45d5-b8e2-eaaa1f93d9f7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:59.121662 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97c0b5a8-6622-45d5-b8e2-eaaa1f93d9f7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:59.122168 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97c0b5a8-6622-45d5-b8e2-eaaa1f93d9f7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:59.122782 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97c0b5a8-6622-45d5-b8e2-eaaa1f93d9f7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:59.123259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97c0b5a8-6622-45d5-b8e2-eaaa1f93d9f7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:59.123673 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97c0b5a8-6622-45d5-b8e2-eaaa1f93d9f7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:59.266281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-431597bb-348c-45ab-8669-1f18f38aae84 req-51815b10-47d2-434d-b4d4-2697a5662206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdcafad1-7223-493c-bb5f-b719847aeb1e", "tag": "53b26cbc-aca0-44fa-b15f-401c8ad8edf3"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:06:59.270031 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-97c0b5a8-6622-45d5-b8e2-eaaa1f93d9f7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:06:59.273902 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=44 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:06:59.278174 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-431597bb-348c-45ab-8669-1f18f38aae84 req-51815b10-47d2-434d-b4d4-2697a5662206 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:59.278624 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-431597bb-348c-45ab-8669-1f18f38aae84 req-51815b10-47d2-434d-b4d4-2697a5662206 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:59.279312 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-431597bb-348c-45ab-8669-1f18f38aae84 req-51815b10-47d2-434d-b4d4-2697a5662206 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:59.284681 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-97c0b5a8-6622-45d5-b8e2-eaaa1f93d9f7 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.175442 Aug 29 19:06:59.291060 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 284/582] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:06:59 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:06:59.293750 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-431597bb-348c-45ab-8669-1f18f38aae84 req-51815b10-47d2-434d-b4d4-2697a5662206 service nova] Creating event network-changed:53b26cbc-aca0-44fa-b15f-401c8ad8edf3 for instance bdcafad1-7223-493c-bb5f-b719847aeb1e on hv-cinder-85083 Aug 29 19:06:59.298862 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-431597bb-348c-45ab-8669-1f18f38aae84 req-51815b10-47d2-434d-b4d4-2697a5662206 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043955 Aug 29 19:06:59.300085 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 299/583] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:06:59.859330 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fc31e344-cf34-4cca-b923-01a2709b80f8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:06:59.859948 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fc31e344-cf34-4cca-b923-01a2709b80f8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:06:59.865894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc31e344-cf34-4cca-b923-01a2709b80f8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:59.866375 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc31e344-cf34-4cca-b923-01a2709b80f8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:59.866816 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc31e344-cf34-4cca-b923-01a2709b80f8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:59.867532 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc31e344-cf34-4cca-b923-01a2709b80f8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:59.867988 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc31e344-cf34-4cca-b923-01a2709b80f8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:59.868456 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc31e344-cf34-4cca-b923-01a2709b80f8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:59.994614 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fc31e344-cf34-4cca-b923-01a2709b80f8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:00.003129 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fc31e344-cf34-4cca-b923-01a2709b80f8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:00.004962 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fc31e344-cf34-4cca-b923-01a2709b80f8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:00.006116 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fc31e344-cf34-4cca-b923-01a2709b80f8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1752 microversion: 2.20 time: 0.150741 Aug 29 19:07:00.006658 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 285/584] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:06:59 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:00.307644 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b9cdf88e-5943-4a2a-9024-10883d7f02bb tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:00.308348 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b9cdf88e-5943-4a2a-9024-10883d7f02bb tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:00.314470 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b9cdf88e-5943-4a2a-9024-10883d7f02bb tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:00.314940 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b9cdf88e-5943-4a2a-9024-10883d7f02bb tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:00.315416 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b9cdf88e-5943-4a2a-9024-10883d7f02bb tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:00.316592 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b9cdf88e-5943-4a2a-9024-10883d7f02bb tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:00.317046 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b9cdf88e-5943-4a2a-9024-10883d7f02bb tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:00.317464 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b9cdf88e-5943-4a2a-9024-10883d7f02bb tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:00.451119 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b9cdf88e-5943-4a2a-9024-10883d7f02bb tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:00.459113 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b9cdf88e-5943-4a2a-9024-10883d7f02bb tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.156248 Aug 29 19:07:00.459676 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 300/585] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:00 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:01.029568 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-eda41a08-8c60-4939-a998-dce86dcfb4d3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:01.030205 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-eda41a08-8c60-4939-a998-dce86dcfb4d3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:01.032655 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:01.039438 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eda41a08-8c60-4939-a998-dce86dcfb4d3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:01.039922 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eda41a08-8c60-4939-a998-dce86dcfb4d3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:01.040358 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eda41a08-8c60-4939-a998-dce86dcfb4d3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:01.041049 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eda41a08-8c60-4939-a998-dce86dcfb4d3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:01.041497 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eda41a08-8c60-4939-a998-dce86dcfb4d3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:01.041916 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eda41a08-8c60-4939-a998-dce86dcfb4d3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:01.169856 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-eda41a08-8c60-4939-a998-dce86dcfb4d3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:01.179196 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-eda41a08-8c60-4939-a998-dce86dcfb4d3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:01.180551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-eda41a08-8c60-4939-a998-dce86dcfb4d3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:01.181704 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-eda41a08-8c60-4939-a998-dce86dcfb4d3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1752 microversion: 2.20 time: 0.156005 Aug 29 19:07:01.182443 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 286/586] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:01 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:01.479635 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3b3768ce-f556-4c55-b5e1-25a060414d06 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:01.480193 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3b3768ce-f556-4c55-b5e1-25a060414d06 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:01.486564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3b3768ce-f556-4c55-b5e1-25a060414d06 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:01.487070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3b3768ce-f556-4c55-b5e1-25a060414d06 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:01.487503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3b3768ce-f556-4c55-b5e1-25a060414d06 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:01.488182 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3b3768ce-f556-4c55-b5e1-25a060414d06 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:01.488629 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3b3768ce-f556-4c55-b5e1-25a060414d06 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:01.489042 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3b3768ce-f556-4c55-b5e1-25a060414d06 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:01.617383 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3b3768ce-f556-4c55-b5e1-25a060414d06 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:01.624861 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3b3768ce-f556-4c55-b5e1-25a060414d06 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.149224 Aug 29 19:07:01.625423 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 301/587] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:01 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:07:02.204448 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-71908ada-9f61-4ce4-9d1c-5431588e2d2e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:02.205086 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-71908ada-9f61-4ce4-9d1c-5431588e2d2e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:02.211674 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-71908ada-9f61-4ce4-9d1c-5431588e2d2e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:02.212154 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-71908ada-9f61-4ce4-9d1c-5431588e2d2e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:02.212590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-71908ada-9f61-4ce4-9d1c-5431588e2d2e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:02.213275 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-71908ada-9f61-4ce4-9d1c-5431588e2d2e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:02.213729 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-71908ada-9f61-4ce4-9d1c-5431588e2d2e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:02.214153 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-71908ada-9f61-4ce4-9d1c-5431588e2d2e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:02.341456 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-71908ada-9f61-4ce4-9d1c-5431588e2d2e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:02.350457 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-71908ada-9f61-4ce4-9d1c-5431588e2d2e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:02.351912 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-71908ada-9f61-4ce4-9d1c-5431588e2d2e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:02.353054 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-71908ada-9f61-4ce4-9d1c-5431588e2d2e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1752 microversion: 2.20 time: 0.152604 Aug 29 19:07:02.353610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 287/588] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:02 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:02.645589 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-514b77d5-a2f0-4946-b0d6-fdc9f076d5c1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:02.646217 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-514b77d5-a2f0-4946-b0d6-fdc9f076d5c1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:02.652607 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-514b77d5-a2f0-4946-b0d6-fdc9f076d5c1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:02.653086 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-514b77d5-a2f0-4946-b0d6-fdc9f076d5c1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:02.653513 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-514b77d5-a2f0-4946-b0d6-fdc9f076d5c1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:02.654187 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-514b77d5-a2f0-4946-b0d6-fdc9f076d5c1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:02.654633 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-514b77d5-a2f0-4946-b0d6-fdc9f076d5c1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:02.655064 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-514b77d5-a2f0-4946-b0d6-fdc9f076d5c1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:02.782173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-514b77d5-a2f0-4946-b0d6-fdc9f076d5c1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:02.790740 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-514b77d5-a2f0-4946-b0d6-fdc9f076d5c1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.148971 Aug 29 19:07:02.791327 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 302/589] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:02 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:03.376576 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f39b8370-31ce-4738-b4a0-7ad1a4ad6e5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:03.377173 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f39b8370-31ce-4738-b4a0-7ad1a4ad6e5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:03.384031 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f39b8370-31ce-4738-b4a0-7ad1a4ad6e5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:03.384502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f39b8370-31ce-4738-b4a0-7ad1a4ad6e5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:03.384926 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f39b8370-31ce-4738-b4a0-7ad1a4ad6e5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:03.385597 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f39b8370-31ce-4738-b4a0-7ad1a4ad6e5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:03.386042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f39b8370-31ce-4738-b4a0-7ad1a4ad6e5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:03.386456 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f39b8370-31ce-4738-b4a0-7ad1a4ad6e5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:03.525866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f39b8370-31ce-4738-b4a0-7ad1a4ad6e5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:03.534887 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f39b8370-31ce-4738-b4a0-7ad1a4ad6e5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:03.536371 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f39b8370-31ce-4738-b4a0-7ad1a4ad6e5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:03.537663 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f39b8370-31ce-4738-b4a0-7ad1a4ad6e5d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1752 microversion: 2.20 time: 0.164942 Aug 29 19:07:03.539459 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 288/590] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:03 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:03.810382 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-85be183c-8a9c-4ab4-ac48-4f3856176f0b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:03.811058 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-85be183c-8a9c-4ab4-ac48-4f3856176f0b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:03.818355 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85be183c-8a9c-4ab4-ac48-4f3856176f0b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:03.818844 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85be183c-8a9c-4ab4-ac48-4f3856176f0b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:03.819303 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85be183c-8a9c-4ab4-ac48-4f3856176f0b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:03.820398 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85be183c-8a9c-4ab4-ac48-4f3856176f0b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:03.820781 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85be183c-8a9c-4ab4-ac48-4f3856176f0b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:03.821239 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85be183c-8a9c-4ab4-ac48-4f3856176f0b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:03.959054 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-85be183c-8a9c-4ab4-ac48-4f3856176f0b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:03.966606 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-85be183c-8a9c-4ab4-ac48-4f3856176f0b tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.160132 Aug 29 19:07:03.967189 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 303/591] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:03 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:04.560584 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9bbf1b74-6ab0-4b68-9568-95a3f55092e6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:04.561186 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9bbf1b74-6ab0-4b68-9568-95a3f55092e6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:04.568095 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9bbf1b74-6ab0-4b68-9568-95a3f55092e6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:04.568578 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9bbf1b74-6ab0-4b68-9568-95a3f55092e6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:04.569010 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9bbf1b74-6ab0-4b68-9568-95a3f55092e6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:04.569781 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9bbf1b74-6ab0-4b68-9568-95a3f55092e6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:04.570439 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9bbf1b74-6ab0-4b68-9568-95a3f55092e6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:04.570856 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9bbf1b74-6ab0-4b68-9568-95a3f55092e6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:04.589349 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:04.607376 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:04.702934 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9bbf1b74-6ab0-4b68-9568-95a3f55092e6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:04.712072 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9bbf1b74-6ab0-4b68-9568-95a3f55092e6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:04.713492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9bbf1b74-6ab0-4b68-9568-95a3f55092e6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:04.714631 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9bbf1b74-6ab0-4b68-9568-95a3f55092e6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.157949 Aug 29 19:07:04.715209 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 289/592] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:04 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:04.988316 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-27853024-3299-473f-b1f7-9cf4b00ac035 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:04.990362 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-27853024-3299-473f-b1f7-9cf4b00ac035 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:04.992400 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:04.999201 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27853024-3299-473f-b1f7-9cf4b00ac035 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:04.999860 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27853024-3299-473f-b1f7-9cf4b00ac035 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:05.000619 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27853024-3299-473f-b1f7-9cf4b00ac035 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:05.001459 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27853024-3299-473f-b1f7-9cf4b00ac035 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:05.001912 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27853024-3299-473f-b1f7-9cf4b00ac035 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:05.002336 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27853024-3299-473f-b1f7-9cf4b00ac035 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:05.137999 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-27853024-3299-473f-b1f7-9cf4b00ac035 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:05.146375 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-27853024-3299-473f-b1f7-9cf4b00ac035 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.161747 Aug 29 19:07:05.147418 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 304/593] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:04 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:05.738119 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7d1db8a7-f812-4116-86d0-1d04ba872071 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:05.738640 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7d1db8a7-f812-4116-86d0-1d04ba872071 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:05.745373 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d1db8a7-f812-4116-86d0-1d04ba872071 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:05.745849 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d1db8a7-f812-4116-86d0-1d04ba872071 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:05.746278 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d1db8a7-f812-4116-86d0-1d04ba872071 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:05.746949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d1db8a7-f812-4116-86d0-1d04ba872071 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:05.747424 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d1db8a7-f812-4116-86d0-1d04ba872071 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:05.747846 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d1db8a7-f812-4116-86d0-1d04ba872071 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:05.908640 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7d1db8a7-f812-4116-86d0-1d04ba872071 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:05.918489 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7d1db8a7-f812-4116-86d0-1d04ba872071 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:05.920052 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7d1db8a7-f812-4116-86d0-1d04ba872071 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:05.921106 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7d1db8a7-f812-4116-86d0-1d04ba872071 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.186960 Aug 29 19:07:05.927044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 290/594] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:05 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:06.167968 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-28515bee-b069-46b3-af2e-679903ddef78 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:06.168649 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-28515bee-b069-46b3-af2e-679903ddef78 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:06.175727 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28515bee-b069-46b3-af2e-679903ddef78 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:06.176595 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28515bee-b069-46b3-af2e-679903ddef78 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:06.177181 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28515bee-b069-46b3-af2e-679903ddef78 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:06.178066 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28515bee-b069-46b3-af2e-679903ddef78 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:06.178752 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28515bee-b069-46b3-af2e-679903ddef78 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:06.179464 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28515bee-b069-46b3-af2e-679903ddef78 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:06.346602 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-28515bee-b069-46b3-af2e-679903ddef78 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:06.354603 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-28515bee-b069-46b3-af2e-679903ddef78 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.190613 Aug 29 19:07:06.355217 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 305/595] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:06 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:06.376428 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-4392287a-f77b-4bca-982c-d7a59865ebad req-8dafffae-572c-41fa-9646-47fea1ac7d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdcafad1-7223-493c-bb5f-b719847aeb1e", "name": "network-vif-plugged", "status": "completed", "tag": "53b26cbc-aca0-44fa-b15f-401c8ad8edf3"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:07:06.388022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-4392287a-f77b-4bca-982c-d7a59865ebad req-8dafffae-572c-41fa-9646-47fea1ac7d48 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:06.388582 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-4392287a-f77b-4bca-982c-d7a59865ebad req-8dafffae-572c-41fa-9646-47fea1ac7d48 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:06.389007 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-4392287a-f77b-4bca-982c-d7a59865ebad req-8dafffae-572c-41fa-9646-47fea1ac7d48 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:06.403101 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-4392287a-f77b-4bca-982c-d7a59865ebad req-8dafffae-572c-41fa-9646-47fea1ac7d48 service nova] Creating event network-vif-plugged:53b26cbc-aca0-44fa-b15f-401c8ad8edf3 for instance bdcafad1-7223-493c-bb5f-b719847aeb1e on hv-cinder-85083 Aug 29 19:07:06.409354 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-4392287a-f77b-4bca-982c-d7a59865ebad req-8dafffae-572c-41fa-9646-47fea1ac7d48 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036877 Aug 29 19:07:06.410020 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 291/596] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:07:06.944066 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d4dc4bba-2c8b-4d3f-97c3-5d3e57bcb339 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:06.944594 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d4dc4bba-2c8b-4d3f-97c3-5d3e57bcb339 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:06.950827 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4dc4bba-2c8b-4d3f-97c3-5d3e57bcb339 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:06.951345 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4dc4bba-2c8b-4d3f-97c3-5d3e57bcb339 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:06.951780 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4dc4bba-2c8b-4d3f-97c3-5d3e57bcb339 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:06.952473 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4dc4bba-2c8b-4d3f-97c3-5d3e57bcb339 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:06.952921 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4dc4bba-2c8b-4d3f-97c3-5d3e57bcb339 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:06.953340 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4dc4bba-2c8b-4d3f-97c3-5d3e57bcb339 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:07.087903 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d4dc4bba-2c8b-4d3f-97c3-5d3e57bcb339 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:07.096892 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d4dc4bba-2c8b-4d3f-97c3-5d3e57bcb339 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:07.099081 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d4dc4bba-2c8b-4d3f-97c3-5d3e57bcb339 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:07.100529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d4dc4bba-2c8b-4d3f-97c3-5d3e57bcb339 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.160310 Aug 29 19:07:07.101526 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 306/597] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:06 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:07.376507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c2d7d43b-c461-492c-9c82-02492cedf463 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:07.377193 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c2d7d43b-c461-492c-9c82-02492cedf463 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:07.383564 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c2d7d43b-c461-492c-9c82-02492cedf463 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:07.384070 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c2d7d43b-c461-492c-9c82-02492cedf463 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:07.384498 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c2d7d43b-c461-492c-9c82-02492cedf463 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:07.385208 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c2d7d43b-c461-492c-9c82-02492cedf463 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:07.385682 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c2d7d43b-c461-492c-9c82-02492cedf463 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:07.386096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c2d7d43b-c461-492c-9c82-02492cedf463 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:07.519100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c2d7d43b-c461-492c-9c82-02492cedf463 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:07.528353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c2d7d43b-c461-492c-9c82-02492cedf463 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.156467 Aug 29 19:07:07.529191 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 292/598] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:07 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:08.124169 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-561a1d17-8bfd-4e2d-b83d-b10591573b83 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:08.124760 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-561a1d17-8bfd-4e2d-b83d-b10591573b83 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:08.132049 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-561a1d17-8bfd-4e2d-b83d-b10591573b83 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:08.132566 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-561a1d17-8bfd-4e2d-b83d-b10591573b83 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:08.133005 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-561a1d17-8bfd-4e2d-b83d-b10591573b83 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:08.133699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-561a1d17-8bfd-4e2d-b83d-b10591573b83 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:08.134153 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-561a1d17-8bfd-4e2d-b83d-b10591573b83 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:08.134576 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-561a1d17-8bfd-4e2d-b83d-b10591573b83 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:08.269896 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-561a1d17-8bfd-4e2d-b83d-b10591573b83 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:08.279243 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-561a1d17-8bfd-4e2d-b83d-b10591573b83 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:08.280804 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-561a1d17-8bfd-4e2d-b83d-b10591573b83 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:08.281965 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-561a1d17-8bfd-4e2d-b83d-b10591573b83 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.161724 Aug 29 19:07:08.282900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 307/599] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:08 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:08.549794 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e46cb1de-48aa-4761-ab1c-00e9864d71dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:08.550439 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e46cb1de-48aa-4761-ab1c-00e9864d71dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:08.558229 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e46cb1de-48aa-4761-ab1c-00e9864d71dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:08.558714 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e46cb1de-48aa-4761-ab1c-00e9864d71dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:08.559179 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e46cb1de-48aa-4761-ab1c-00e9864d71dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:08.559885 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e46cb1de-48aa-4761-ab1c-00e9864d71dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:08.560341 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e46cb1de-48aa-4761-ab1c-00e9864d71dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:08.560766 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e46cb1de-48aa-4761-ab1c-00e9864d71dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:08.712269 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e46cb1de-48aa-4761-ab1c-00e9864d71dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:08.720137 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e46cb1de-48aa-4761-ab1c-00e9864d71dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.174511 Aug 29 19:07:08.720717 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 293/600] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:08 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:09.305173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-44428023-f414-4332-a10b-c2e507b7ae4f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:09.305777 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-44428023-f414-4332-a10b-c2e507b7ae4f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:09.312187 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44428023-f414-4332-a10b-c2e507b7ae4f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:09.312666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44428023-f414-4332-a10b-c2e507b7ae4f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:09.313098 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44428023-f414-4332-a10b-c2e507b7ae4f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:09.313814 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44428023-f414-4332-a10b-c2e507b7ae4f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:09.314261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44428023-f414-4332-a10b-c2e507b7ae4f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:09.314682 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-44428023-f414-4332-a10b-c2e507b7ae4f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:09.448790 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-44428023-f414-4332-a10b-c2e507b7ae4f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:09.459374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-44428023-f414-4332-a10b-c2e507b7ae4f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:09.460831 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-44428023-f414-4332-a10b-c2e507b7ae4f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:09.462112 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-44428023-f414-4332-a10b-c2e507b7ae4f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.160716 Aug 29 19:07:09.463059 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 308/601] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:09 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:09.745663 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fb60e183-22a1-4000-a3cc-3d9ef6a289f4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:09.746289 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fb60e183-22a1-4000-a3cc-3d9ef6a289f4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:09.752723 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fb60e183-22a1-4000-a3cc-3d9ef6a289f4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:09.753210 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fb60e183-22a1-4000-a3cc-3d9ef6a289f4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:09.753645 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fb60e183-22a1-4000-a3cc-3d9ef6a289f4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:09.754987 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fb60e183-22a1-4000-a3cc-3d9ef6a289f4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:09.755482 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fb60e183-22a1-4000-a3cc-3d9ef6a289f4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:09.755905 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fb60e183-22a1-4000-a3cc-3d9ef6a289f4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:09.888267 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fb60e183-22a1-4000-a3cc-3d9ef6a289f4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:09.896211 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fb60e183-22a1-4000-a3cc-3d9ef6a289f4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.154559 Aug 29 19:07:09.896815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 294/602] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:09 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:10.484846 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2d7e5721-e31f-4c5f-822c-60039a8c9046 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:10.485542 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2d7e5721-e31f-4c5f-822c-60039a8c9046 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:10.492361 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d7e5721-e31f-4c5f-822c-60039a8c9046 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:10.492849 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d7e5721-e31f-4c5f-822c-60039a8c9046 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:10.493289 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d7e5721-e31f-4c5f-822c-60039a8c9046 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:10.494028 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d7e5721-e31f-4c5f-822c-60039a8c9046 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:10.494510 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d7e5721-e31f-4c5f-822c-60039a8c9046 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:10.494948 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d7e5721-e31f-4c5f-822c-60039a8c9046 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:10.643372 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2d7e5721-e31f-4c5f-822c-60039a8c9046 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:10.652696 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2d7e5721-e31f-4c5f-822c-60039a8c9046 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:10.654153 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2d7e5721-e31f-4c5f-822c-60039a8c9046 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:10.655358 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2d7e5721-e31f-4c5f-822c-60039a8c9046 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.174376 Aug 29 19:07:10.655915 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 309/603] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:10 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:10.916915 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1a8d6475-b481-4194-836a-610931c6b056 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:10.917568 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1a8d6475-b481-4194-836a-610931c6b056 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:10.923925 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a8d6475-b481-4194-836a-610931c6b056 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:10.924400 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a8d6475-b481-4194-836a-610931c6b056 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:10.925126 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a8d6475-b481-4194-836a-610931c6b056 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:10.925528 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a8d6475-b481-4194-836a-610931c6b056 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:10.925974 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a8d6475-b481-4194-836a-610931c6b056 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:10.926389 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a8d6475-b481-4194-836a-610931c6b056 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:11.060727 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1a8d6475-b481-4194-836a-610931c6b056 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:11.069458 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1a8d6475-b481-4194-836a-610931c6b056 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.156264 Aug 29 19:07:11.070287 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 295/604] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:10 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:07:11.679178 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-93b62e0f-388c-47b4-bcd6-1d97ef8ae601 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:11.680168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-93b62e0f-388c-47b4-bcd6-1d97ef8ae601 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:11.686833 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93b62e0f-388c-47b4-bcd6-1d97ef8ae601 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:11.687358 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93b62e0f-388c-47b4-bcd6-1d97ef8ae601 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:11.687792 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93b62e0f-388c-47b4-bcd6-1d97ef8ae601 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:11.688648 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93b62e0f-388c-47b4-bcd6-1d97ef8ae601 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:11.689177 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93b62e0f-388c-47b4-bcd6-1d97ef8ae601 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:11.689616 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93b62e0f-388c-47b4-bcd6-1d97ef8ae601 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:11.825154 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-93b62e0f-388c-47b4-bcd6-1d97ef8ae601 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:11.836710 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-93b62e0f-388c-47b4-bcd6-1d97ef8ae601 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:11.838171 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-93b62e0f-388c-47b4-bcd6-1d97ef8ae601 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:11.839393 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-93b62e0f-388c-47b4-bcd6-1d97ef8ae601 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.165172 Aug 29 19:07:11.839959 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 310/605] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:11 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:07:12.091698 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f459cd81-3f4e-41e3-b2f7-40c79a49fc28 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:12.092378 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f459cd81-3f4e-41e3-b2f7-40c79a49fc28 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:12.099578 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f459cd81-3f4e-41e3-b2f7-40c79a49fc28 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:12.100058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f459cd81-3f4e-41e3-b2f7-40c79a49fc28 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:12.100486 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f459cd81-3f4e-41e3-b2f7-40c79a49fc28 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:12.101215 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f459cd81-3f4e-41e3-b2f7-40c79a49fc28 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:12.101660 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f459cd81-3f4e-41e3-b2f7-40c79a49fc28 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:12.102076 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f459cd81-3f4e-41e3-b2f7-40c79a49fc28 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:12.248365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f459cd81-3f4e-41e3-b2f7-40c79a49fc28 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:12.257034 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f459cd81-3f4e-41e3-b2f7-40c79a49fc28 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.169054 Aug 29 19:07:12.266514 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 296/606] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:12 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:12.863393 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dff93ebf-b425-4d90-876e-3923cfad2324 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:12.864793 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dff93ebf-b425-4d90-876e-3923cfad2324 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:12.871507 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dff93ebf-b425-4d90-876e-3923cfad2324 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:12.871997 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dff93ebf-b425-4d90-876e-3923cfad2324 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:12.872467 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dff93ebf-b425-4d90-876e-3923cfad2324 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:12.873185 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dff93ebf-b425-4d90-876e-3923cfad2324 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:12.873622 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dff93ebf-b425-4d90-876e-3923cfad2324 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:12.874213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dff93ebf-b425-4d90-876e-3923cfad2324 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:13.014362 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dff93ebf-b425-4d90-876e-3923cfad2324 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:13.024124 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dff93ebf-b425-4d90-876e-3923cfad2324 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:13.025573 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dff93ebf-b425-4d90-876e-3923cfad2324 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:13.026736 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dff93ebf-b425-4d90-876e-3923cfad2324 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.167374 Aug 29 19:07:13.027330 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 311/607] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:12 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:13.278259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bbad002b-72ff-4e16-8b3d-a4a79fcc7ed3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:13.278849 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bbad002b-72ff-4e16-8b3d-a4a79fcc7ed3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:13.285197 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bbad002b-72ff-4e16-8b3d-a4a79fcc7ed3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:13.286275 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bbad002b-72ff-4e16-8b3d-a4a79fcc7ed3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:13.286794 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bbad002b-72ff-4e16-8b3d-a4a79fcc7ed3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:13.287509 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bbad002b-72ff-4e16-8b3d-a4a79fcc7ed3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:13.287963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bbad002b-72ff-4e16-8b3d-a4a79fcc7ed3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:13.288381 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bbad002b-72ff-4e16-8b3d-a4a79fcc7ed3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:13.424143 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bbad002b-72ff-4e16-8b3d-a4a79fcc7ed3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:13.434717 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bbad002b-72ff-4e16-8b3d-a4a79fcc7ed3 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.160434 Aug 29 19:07:13.435338 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 297/608] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:13 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:14.050027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5f7fe4de-2538-4be6-b84e-57fd97578277 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:14.050636 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5f7fe4de-2538-4be6-b84e-57fd97578277 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:14.057549 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f7fe4de-2538-4be6-b84e-57fd97578277 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:14.058026 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f7fe4de-2538-4be6-b84e-57fd97578277 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:14.058454 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f7fe4de-2538-4be6-b84e-57fd97578277 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:14.059164 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f7fe4de-2538-4be6-b84e-57fd97578277 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:14.059610 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f7fe4de-2538-4be6-b84e-57fd97578277 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:14.060025 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f7fe4de-2538-4be6-b84e-57fd97578277 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:14.193953 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5f7fe4de-2538-4be6-b84e-57fd97578277 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:14.203065 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5f7fe4de-2538-4be6-b84e-57fd97578277 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:14.204503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5f7fe4de-2538-4be6-b84e-57fd97578277 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:14.205651 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5f7fe4de-2538-4be6-b84e-57fd97578277 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.159514 Aug 29 19:07:14.206201 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 312/609] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:14 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:14.456980 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fce6a0de-94d1-4bc1-a74e-92819eb32d12 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:14.457505 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fce6a0de-94d1-4bc1-a74e-92819eb32d12 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:14.464085 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fce6a0de-94d1-4bc1-a74e-92819eb32d12 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:14.464577 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fce6a0de-94d1-4bc1-a74e-92819eb32d12 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:14.465011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fce6a0de-94d1-4bc1-a74e-92819eb32d12 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:14.465709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fce6a0de-94d1-4bc1-a74e-92819eb32d12 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:14.466160 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fce6a0de-94d1-4bc1-a74e-92819eb32d12 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:14.466606 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fce6a0de-94d1-4bc1-a74e-92819eb32d12 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:14.620564 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fce6a0de-94d1-4bc1-a74e-92819eb32d12 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:14.629499 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fce6a0de-94d1-4bc1-a74e-92819eb32d12 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.176352 Aug 29 19:07:14.635217 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 298/610] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:14 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:15.229480 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f538fa45-c377-4f29-8fd4-9d437d8f0603 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:15.230048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f538fa45-c377-4f29-8fd4-9d437d8f0603 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:15.236792 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f538fa45-c377-4f29-8fd4-9d437d8f0603 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:15.237422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f538fa45-c377-4f29-8fd4-9d437d8f0603 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:15.237971 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f538fa45-c377-4f29-8fd4-9d437d8f0603 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:15.238815 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f538fa45-c377-4f29-8fd4-9d437d8f0603 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:15.239286 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f538fa45-c377-4f29-8fd4-9d437d8f0603 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:15.240462 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f538fa45-c377-4f29-8fd4-9d437d8f0603 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:15.390791 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f538fa45-c377-4f29-8fd4-9d437d8f0603 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:15.406866 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f538fa45-c377-4f29-8fd4-9d437d8f0603 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:15.408673 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f538fa45-c377-4f29-8fd4-9d437d8f0603 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:15.409845 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f538fa45-c377-4f29-8fd4-9d437d8f0603 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.184931 Aug 29 19:07:15.410409 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 313/611] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:15 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:15.649814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2b3813d3-6ca0-4da4-b634-8118a67125b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:15.651138 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2b3813d3-6ca0-4da4-b634-8118a67125b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:15.657549 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b3813d3-6ca0-4da4-b634-8118a67125b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:15.658070 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b3813d3-6ca0-4da4-b634-8118a67125b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:15.658502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b3813d3-6ca0-4da4-b634-8118a67125b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:15.659229 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b3813d3-6ca0-4da4-b634-8118a67125b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:15.659683 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b3813d3-6ca0-4da4-b634-8118a67125b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:15.660103 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b3813d3-6ca0-4da4-b634-8118a67125b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:15.794596 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2b3813d3-6ca0-4da4-b634-8118a67125b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:15.803346 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2b3813d3-6ca0-4da4-b634-8118a67125b1 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.157486 Aug 29 19:07:15.803944 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 299/612] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:15 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:16.432052 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4c19686e-8838-4877-b2a6-21a5b8bc140f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:16.432695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4c19686e-8838-4877-b2a6-21a5b8bc140f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:16.439945 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c19686e-8838-4877-b2a6-21a5b8bc140f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:16.440530 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c19686e-8838-4877-b2a6-21a5b8bc140f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:16.441041 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c19686e-8838-4877-b2a6-21a5b8bc140f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:16.441842 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c19686e-8838-4877-b2a6-21a5b8bc140f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:16.442444 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c19686e-8838-4877-b2a6-21a5b8bc140f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:16.443518 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c19686e-8838-4877-b2a6-21a5b8bc140f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:16.586158 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4c19686e-8838-4877-b2a6-21a5b8bc140f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:16.594842 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4c19686e-8838-4877-b2a6-21a5b8bc140f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:16.596312 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4c19686e-8838-4877-b2a6-21a5b8bc140f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:16.597467 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4c19686e-8838-4877-b2a6-21a5b8bc140f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.169383 Aug 29 19:07:16.598012 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 314/613] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:16 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:16.825617 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-84afabbb-2b26-47fe-964b-e088580c6a2d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:16.826219 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-84afabbb-2b26-47fe-964b-e088580c6a2d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:16.833028 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84afabbb-2b26-47fe-964b-e088580c6a2d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:16.833611 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84afabbb-2b26-47fe-964b-e088580c6a2d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:16.834055 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84afabbb-2b26-47fe-964b-e088580c6a2d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:16.834878 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84afabbb-2b26-47fe-964b-e088580c6a2d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:16.835375 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84afabbb-2b26-47fe-964b-e088580c6a2d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:16.835809 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84afabbb-2b26-47fe-964b-e088580c6a2d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:16.974573 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-84afabbb-2b26-47fe-964b-e088580c6a2d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:16.978255 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:16.983150 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-84afabbb-2b26-47fe-964b-e088580c6a2d tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.161370 Aug 29 19:07:16.983721 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 300/614] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:16 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:17.620990 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f771453c-2557-4931-ab51-6bfff381f94c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:17.621591 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f771453c-2557-4931-ab51-6bfff381f94c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:17.628000 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f771453c-2557-4931-ab51-6bfff381f94c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:17.628481 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f771453c-2557-4931-ab51-6bfff381f94c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:17.628914 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f771453c-2557-4931-ab51-6bfff381f94c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:17.629598 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f771453c-2557-4931-ab51-6bfff381f94c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:17.630048 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f771453c-2557-4931-ab51-6bfff381f94c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:17.630467 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f771453c-2557-4931-ab51-6bfff381f94c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:17.634538 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:17.776758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f771453c-2557-4931-ab51-6bfff381f94c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:17.785552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f771453c-2557-4931-ab51-6bfff381f94c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:17.787060 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f771453c-2557-4931-ab51-6bfff381f94c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:17.788304 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f771453c-2557-4931-ab51-6bfff381f94c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.171212 Aug 29 19:07:17.789053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 315/615] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:17 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:18.004530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-399dd985-4fb0-4293-a768-80e9682054d6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:18.005173 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-399dd985-4fb0-4293-a768-80e9682054d6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:18.012898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-399dd985-4fb0-4293-a768-80e9682054d6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:18.013663 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-399dd985-4fb0-4293-a768-80e9682054d6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:18.014099 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-399dd985-4fb0-4293-a768-80e9682054d6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:18.014971 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-399dd985-4fb0-4293-a768-80e9682054d6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:18.015452 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-399dd985-4fb0-4293-a768-80e9682054d6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:18.015965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-399dd985-4fb0-4293-a768-80e9682054d6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:18.153232 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-399dd985-4fb0-4293-a768-80e9682054d6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:18.162162 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-399dd985-4fb0-4293-a768-80e9682054d6 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.161700 Aug 29 19:07:18.162855 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 301/616] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:17 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:18.811460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e58c8866-f60b-4103-bddf-04be83a9f73c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:18.812101 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e58c8866-f60b-4103-bddf-04be83a9f73c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:18.818612 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e58c8866-f60b-4103-bddf-04be83a9f73c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:18.819126 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e58c8866-f60b-4103-bddf-04be83a9f73c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:18.819657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e58c8866-f60b-4103-bddf-04be83a9f73c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:18.820608 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e58c8866-f60b-4103-bddf-04be83a9f73c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:18.821053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e58c8866-f60b-4103-bddf-04be83a9f73c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:18.821476 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e58c8866-f60b-4103-bddf-04be83a9f73c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:18.954006 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e58c8866-f60b-4103-bddf-04be83a9f73c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:18.964153 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e58c8866-f60b-4103-bddf-04be83a9f73c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:18.965923 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e58c8866-f60b-4103-bddf-04be83a9f73c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:18.967258 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e58c8866-f60b-4103-bddf-04be83a9f73c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.159868 Aug 29 19:07:18.967824 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 316/617] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:18 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:19.183280 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-30fc1130-3f88-4e7a-9fde-b07898d73957 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:19.183951 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-30fc1130-3f88-4e7a-9fde-b07898d73957 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:19.190443 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30fc1130-3f88-4e7a-9fde-b07898d73957 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:19.190919 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30fc1130-3f88-4e7a-9fde-b07898d73957 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:19.191385 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30fc1130-3f88-4e7a-9fde-b07898d73957 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:19.192068 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30fc1130-3f88-4e7a-9fde-b07898d73957 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:19.192515 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30fc1130-3f88-4e7a-9fde-b07898d73957 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:19.193425 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30fc1130-3f88-4e7a-9fde-b07898d73957 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:19.320808 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-30fc1130-3f88-4e7a-9fde-b07898d73957 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:19.328616 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-30fc1130-3f88-4e7a-9fde-b07898d73957 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.149400 Aug 29 19:07:19.329184 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 302/618] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:19 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:19.991186 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f042164e-2e25-4caf-8cca-65df6c647ae1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:19.991833 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f042164e-2e25-4caf-8cca-65df6c647ae1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:19.998214 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f042164e-2e25-4caf-8cca-65df6c647ae1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:19.998692 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f042164e-2e25-4caf-8cca-65df6c647ae1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:19.999150 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f042164e-2e25-4caf-8cca-65df6c647ae1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:19.999829 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f042164e-2e25-4caf-8cca-65df6c647ae1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:20.000274 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f042164e-2e25-4caf-8cca-65df6c647ae1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:20.000694 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f042164e-2e25-4caf-8cca-65df6c647ae1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:20.134453 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f042164e-2e25-4caf-8cca-65df6c647ae1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:20.144590 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f042164e-2e25-4caf-8cca-65df6c647ae1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:20.146076 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f042164e-2e25-4caf-8cca-65df6c647ae1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:20.148489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f042164e-2e25-4caf-8cca-65df6c647ae1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.161878 Aug 29 19:07:20.149105 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 317/619] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:19 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:20.350271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5a0d25f8-9f03-4afe-ad72-ab98bff1425f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:20.350884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5a0d25f8-9f03-4afe-ad72-ab98bff1425f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:20.357231 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5a0d25f8-9f03-4afe-ad72-ab98bff1425f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:20.357703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5a0d25f8-9f03-4afe-ad72-ab98bff1425f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:20.358135 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5a0d25f8-9f03-4afe-ad72-ab98bff1425f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:20.358807 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5a0d25f8-9f03-4afe-ad72-ab98bff1425f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:20.359281 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5a0d25f8-9f03-4afe-ad72-ab98bff1425f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:20.359695 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5a0d25f8-9f03-4afe-ad72-ab98bff1425f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:20.489772 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5a0d25f8-9f03-4afe-ad72-ab98bff1425f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:20.497315 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5a0d25f8-9f03-4afe-ad72-ab98bff1425f tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.151513 Aug 29 19:07:20.497874 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 303/620] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:20 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:21.172902 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-15264b65-ab60-4b77-81a2-80dc2aff75b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:21.173507 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-15264b65-ab60-4b77-81a2-80dc2aff75b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:21.180318 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15264b65-ab60-4b77-81a2-80dc2aff75b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:21.180798 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15264b65-ab60-4b77-81a2-80dc2aff75b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:21.181223 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15264b65-ab60-4b77-81a2-80dc2aff75b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:21.181893 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15264b65-ab60-4b77-81a2-80dc2aff75b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:21.182339 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15264b65-ab60-4b77-81a2-80dc2aff75b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:21.182755 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15264b65-ab60-4b77-81a2-80dc2aff75b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:21.309553 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-15264b65-ab60-4b77-81a2-80dc2aff75b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:21.318595 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-15264b65-ab60-4b77-81a2-80dc2aff75b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:21.320503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-15264b65-ab60-4b77-81a2-80dc2aff75b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:21.321640 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-15264b65-ab60-4b77-81a2-80dc2aff75b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.152591 Aug 29 19:07:21.322196 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 318/621] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:21 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:21.517773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fc75f338-fc72-4aed-bba5-e47c6d11b9f9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:21.518386 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fc75f338-fc72-4aed-bba5-e47c6d11b9f9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:21.524804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc75f338-fc72-4aed-bba5-e47c6d11b9f9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:21.525290 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc75f338-fc72-4aed-bba5-e47c6d11b9f9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:21.525722 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc75f338-fc72-4aed-bba5-e47c6d11b9f9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:21.526410 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc75f338-fc72-4aed-bba5-e47c6d11b9f9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:21.526864 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc75f338-fc72-4aed-bba5-e47c6d11b9f9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:21.527320 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc75f338-fc72-4aed-bba5-e47c6d11b9f9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:21.655514 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fc75f338-fc72-4aed-bba5-e47c6d11b9f9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:21.663949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fc75f338-fc72-4aed-bba5-e47c6d11b9f9 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.150028 Aug 29 19:07:21.664511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 304/622] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:21 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:22.343426 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d6b4f9cf-db5e-4ecf-a0d9-255fde9c1221 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:22.344144 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d6b4f9cf-db5e-4ecf-a0d9-255fde9c1221 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:22.351155 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6b4f9cf-db5e-4ecf-a0d9-255fde9c1221 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:22.351637 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6b4f9cf-db5e-4ecf-a0d9-255fde9c1221 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:22.352074 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6b4f9cf-db5e-4ecf-a0d9-255fde9c1221 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:22.352758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6b4f9cf-db5e-4ecf-a0d9-255fde9c1221 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:22.353210 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6b4f9cf-db5e-4ecf-a0d9-255fde9c1221 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:22.353632 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6b4f9cf-db5e-4ecf-a0d9-255fde9c1221 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:22.490743 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d6b4f9cf-db5e-4ecf-a0d9-255fde9c1221 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:22.499231 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d6b4f9cf-db5e-4ecf-a0d9-255fde9c1221 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:22.500662 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d6b4f9cf-db5e-4ecf-a0d9-255fde9c1221 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:22.501880 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d6b4f9cf-db5e-4ecf-a0d9-255fde9c1221 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.162358 Aug 29 19:07:22.502440 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 319/623] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:22 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:22.684511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-01a2b75a-df89-435e-b5aa-eedb8eafdf25 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:22.685188 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-01a2b75a-df89-435e-b5aa-eedb8eafdf25 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:22.691670 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-01a2b75a-df89-435e-b5aa-eedb8eafdf25 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:22.692153 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-01a2b75a-df89-435e-b5aa-eedb8eafdf25 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:22.692586 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-01a2b75a-df89-435e-b5aa-eedb8eafdf25 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:22.693944 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-01a2b75a-df89-435e-b5aa-eedb8eafdf25 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:22.694442 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-01a2b75a-df89-435e-b5aa-eedb8eafdf25 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:22.694898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-01a2b75a-df89-435e-b5aa-eedb8eafdf25 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:23.064202 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-01a2b75a-df89-435e-b5aa-eedb8eafdf25 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:23.072396 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-01a2b75a-df89-435e-b5aa-eedb8eafdf25 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.391880 Aug 29 19:07:23.072956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 305/624] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:22 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:23.525659 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ded9b393-1868-42a0-a058-80a9ac5c3db3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:23.526271 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ded9b393-1868-42a0-a058-80a9ac5c3db3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:23.534035 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ded9b393-1868-42a0-a058-80a9ac5c3db3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:23.534524 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ded9b393-1868-42a0-a058-80a9ac5c3db3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:23.534963 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ded9b393-1868-42a0-a058-80a9ac5c3db3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:23.535696 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ded9b393-1868-42a0-a058-80a9ac5c3db3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:23.536152 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ded9b393-1868-42a0-a058-80a9ac5c3db3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:23.536585 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ded9b393-1868-42a0-a058-80a9ac5c3db3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:23.669359 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ded9b393-1868-42a0-a058-80a9ac5c3db3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:23.677818 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ded9b393-1868-42a0-a058-80a9ac5c3db3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:23.679395 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ded9b393-1868-42a0-a058-80a9ac5c3db3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:23.680565 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ded9b393-1868-42a0-a058-80a9ac5c3db3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.159519 Aug 29 19:07:23.681126 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 320/625] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:23 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:24.093237 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8d0acd0d-9d5f-4b58-97fd-6e3f5356a805 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:24.093851 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8d0acd0d-9d5f-4b58-97fd-6e3f5356a805 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:24.100287 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8d0acd0d-9d5f-4b58-97fd-6e3f5356a805 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:24.100765 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8d0acd0d-9d5f-4b58-97fd-6e3f5356a805 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:24.101205 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8d0acd0d-9d5f-4b58-97fd-6e3f5356a805 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:24.101889 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8d0acd0d-9d5f-4b58-97fd-6e3f5356a805 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:24.102339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8d0acd0d-9d5f-4b58-97fd-6e3f5356a805 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:24.102756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8d0acd0d-9d5f-4b58-97fd-6e3f5356a805 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:24.230831 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8d0acd0d-9d5f-4b58-97fd-6e3f5356a805 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:24.238535 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8d0acd0d-9d5f-4b58-97fd-6e3f5356a805 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.149193 Aug 29 19:07:24.239114 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 306/626] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:24 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:24.704052 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-47192855-5241-4adb-a975-c00fd4086ac4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:24.704659 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-47192855-5241-4adb-a975-c00fd4086ac4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:24.711192 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47192855-5241-4adb-a975-c00fd4086ac4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:24.711668 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47192855-5241-4adb-a975-c00fd4086ac4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:24.712094 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47192855-5241-4adb-a975-c00fd4086ac4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:24.712769 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47192855-5241-4adb-a975-c00fd4086ac4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:24.713234 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47192855-5241-4adb-a975-c00fd4086ac4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:24.713648 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47192855-5241-4adb-a975-c00fd4086ac4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:24.840689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-47192855-5241-4adb-a975-c00fd4086ac4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:24.849690 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-47192855-5241-4adb-a975-c00fd4086ac4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:24.851161 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-47192855-5241-4adb-a975-c00fd4086ac4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:24.852311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-47192855-5241-4adb-a975-c00fd4086ac4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.152130 Aug 29 19:07:24.852865 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 321/627] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:24 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:25.260374 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-25a431fa-87a1-47e6-b8a3-c225a2ce6660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:25.260990 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-25a431fa-87a1-47e6-b8a3-c225a2ce6660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:25.267521 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25a431fa-87a1-47e6-b8a3-c225a2ce6660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:25.268001 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25a431fa-87a1-47e6-b8a3-c225a2ce6660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:25.268434 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25a431fa-87a1-47e6-b8a3-c225a2ce6660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:25.269112 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25a431fa-87a1-47e6-b8a3-c225a2ce6660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:25.269563 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25a431fa-87a1-47e6-b8a3-c225a2ce6660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:25.269981 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25a431fa-87a1-47e6-b8a3-c225a2ce6660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:25.397086 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-25a431fa-87a1-47e6-b8a3-c225a2ce6660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:25.410064 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-25a431fa-87a1-47e6-b8a3-c225a2ce6660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.153570 Aug 29 19:07:25.415424 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 307/628] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:25 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:25.874959 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e72337da-7c2e-467d-8a6c-1c292b2698b1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:25.875514 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e72337da-7c2e-467d-8a6c-1c292b2698b1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:25.882719 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e72337da-7c2e-467d-8a6c-1c292b2698b1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:25.883230 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e72337da-7c2e-467d-8a6c-1c292b2698b1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:25.883667 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e72337da-7c2e-467d-8a6c-1c292b2698b1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:25.884349 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e72337da-7c2e-467d-8a6c-1c292b2698b1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:25.884803 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e72337da-7c2e-467d-8a6c-1c292b2698b1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:25.885225 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e72337da-7c2e-467d-8a6c-1c292b2698b1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:26.013495 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e72337da-7c2e-467d-8a6c-1c292b2698b1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:26.022101 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e72337da-7c2e-467d-8a6c-1c292b2698b1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:26.023572 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e72337da-7c2e-467d-8a6c-1c292b2698b1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:26.024724 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e72337da-7c2e-467d-8a6c-1c292b2698b1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.153836 Aug 29 19:07:26.025282 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 322/629] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:25 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:26.429897 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8c2fb8fe-bb0f-42cf-b3d4-a129c1fe42a2 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:26.430506 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8c2fb8fe-bb0f-42cf-b3d4-a129c1fe42a2 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:26.436907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c2fb8fe-bb0f-42cf-b3d4-a129c1fe42a2 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:26.437394 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c2fb8fe-bb0f-42cf-b3d4-a129c1fe42a2 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:26.437851 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c2fb8fe-bb0f-42cf-b3d4-a129c1fe42a2 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:26.438535 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c2fb8fe-bb0f-42cf-b3d4-a129c1fe42a2 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:26.438985 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c2fb8fe-bb0f-42cf-b3d4-a129c1fe42a2 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:26.439454 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c2fb8fe-bb0f-42cf-b3d4-a129c1fe42a2 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:26.564366 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8c2fb8fe-bb0f-42cf-b3d4-a129c1fe42a2 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:26.572234 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8c2fb8fe-bb0f-42cf-b3d4-a129c1fe42a2 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1318 microversion: 2.1 time: 0.146219 Aug 29 19:07:26.572796 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 308/630] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:26 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:27.048516 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ede0983e-a428-4ab0-8730-a6436c647b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:27.049178 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ede0983e-a428-4ab0-8730-a6436c647b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:27.056124 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ede0983e-a428-4ab0-8730-a6436c647b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:27.056607 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ede0983e-a428-4ab0-8730-a6436c647b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:27.057057 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ede0983e-a428-4ab0-8730-a6436c647b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:27.057786 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ede0983e-a428-4ab0-8730-a6436c647b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:27.058240 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ede0983e-a428-4ab0-8730-a6436c647b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:27.058663 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ede0983e-a428-4ab0-8730-a6436c647b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:27.189534 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ede0983e-a428-4ab0-8730-a6436c647b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:27.198383 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ede0983e-a428-4ab0-8730-a6436c647b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:27.199851 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ede0983e-a428-4ab0-8730-a6436c647b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:27.201031 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ede0983e-a428-4ab0-8730-a6436c647b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.156454 Aug 29 19:07:27.201594 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 323/631] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:27 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:27.593252 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f13fd06f-dd42-433e-b1a1-273ec92a9d56 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:27.593865 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f13fd06f-dd42-433e-b1a1-273ec92a9d56 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:27.600506 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f13fd06f-dd42-433e-b1a1-273ec92a9d56 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:27.600987 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f13fd06f-dd42-433e-b1a1-273ec92a9d56 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:27.601425 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f13fd06f-dd42-433e-b1a1-273ec92a9d56 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:27.602113 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f13fd06f-dd42-433e-b1a1-273ec92a9d56 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:27.602566 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f13fd06f-dd42-433e-b1a1-273ec92a9d56 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:27.602989 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f13fd06f-dd42-433e-b1a1-273ec92a9d56 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:27.729607 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f13fd06f-dd42-433e-b1a1-273ec92a9d56 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:27.737291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f13fd06f-dd42-433e-b1a1-273ec92a9d56 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1506 microversion: 2.1 time: 0.147899 Aug 29 19:07:27.737916 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 309/632] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:27 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:27.758261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0c6bfbd9-9226-4393-9936-22ad69078660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03008f16-37da-4391-8d16-9b912342892a", "device": "/dev/sdb"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:07:27.761185 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0c6bfbd9-9226-4393-9936-22ad69078660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:27.767206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c6bfbd9-9226-4393-9936-22ad69078660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:27.767688 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c6bfbd9-9226-4393-9936-22ad69078660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:27.768118 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c6bfbd9-9226-4393-9936-22ad69078660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:27.768824 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c6bfbd9-9226-4393-9936-22ad69078660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:27.769278 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c6bfbd9-9226-4393-9936-22ad69078660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:27.769697 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c6bfbd9-9226-4393-9936-22ad69078660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:28.069742 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0c6bfbd9-9226-4393-9936-22ad69078660 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "POST /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315715 Aug 29 19:07:28.070685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 324/633] 10.222.0.86 () {60 vars in 1323 bytes} [Mon Aug 29 19:07:27 2022] POST /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:07:28.223552 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ffec6728-8076-49d7-9581-145c4e9b8278 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:28.224651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ffec6728-8076-49d7-9581-145c4e9b8278 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:28.230671 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ffec6728-8076-49d7-9581-145c4e9b8278 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:28.231198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ffec6728-8076-49d7-9581-145c4e9b8278 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:28.231644 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ffec6728-8076-49d7-9581-145c4e9b8278 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:28.232329 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ffec6728-8076-49d7-9581-145c4e9b8278 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:28.232783 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ffec6728-8076-49d7-9581-145c4e9b8278 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:28.233209 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ffec6728-8076-49d7-9581-145c4e9b8278 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:28.361550 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ffec6728-8076-49d7-9581-145c4e9b8278 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:28.375461 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ffec6728-8076-49d7-9581-145c4e9b8278 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:28.376894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ffec6728-8076-49d7-9581-145c4e9b8278 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:28.378077 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ffec6728-8076-49d7-9581-145c4e9b8278 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.158465 Aug 29 19:07:28.378640 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 310/634] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:28 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:29.402989 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-de9e7fa3-ffd9-44f9-90dd-b0198fce695c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:29.403658 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-de9e7fa3-ffd9-44f9-90dd-b0198fce695c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:29.405621 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=52 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:29.411275 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de9e7fa3-ffd9-44f9-90dd-b0198fce695c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:29.411763 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de9e7fa3-ffd9-44f9-90dd-b0198fce695c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:29.412200 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de9e7fa3-ffd9-44f9-90dd-b0198fce695c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:29.412892 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de9e7fa3-ffd9-44f9-90dd-b0198fce695c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:29.413349 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de9e7fa3-ffd9-44f9-90dd-b0198fce695c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:29.413777 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de9e7fa3-ffd9-44f9-90dd-b0198fce695c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:29.545377 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-de9e7fa3-ffd9-44f9-90dd-b0198fce695c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:29.554765 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-de9e7fa3-ffd9-44f9-90dd-b0198fce695c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:29.556385 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-de9e7fa3-ffd9-44f9-90dd-b0198fce695c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:29.557578 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-de9e7fa3-ffd9-44f9-90dd-b0198fce695c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.159482 Aug 29 19:07:29.558136 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 325/635] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:29 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:30.581242 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-036ca903-d191-4865-96c0-55398477eeb2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:30.581852 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-036ca903-d191-4865-96c0-55398477eeb2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:30.588307 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-036ca903-d191-4865-96c0-55398477eeb2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:30.588785 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-036ca903-d191-4865-96c0-55398477eeb2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:30.589219 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-036ca903-d191-4865-96c0-55398477eeb2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:30.589903 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-036ca903-d191-4865-96c0-55398477eeb2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:30.590355 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-036ca903-d191-4865-96c0-55398477eeb2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:30.590774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-036ca903-d191-4865-96c0-55398477eeb2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:30.734758 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-036ca903-d191-4865-96c0-55398477eeb2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:30.744502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-036ca903-d191-4865-96c0-55398477eeb2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:30.745938 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-036ca903-d191-4865-96c0-55398477eeb2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:30.747205 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-036ca903-d191-4865-96c0-55398477eeb2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.169769 Aug 29 19:07:30.747756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 311/636] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:30 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:31.769575 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3724db8b-4925-4204-83fe-9d43238a768f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:31.770175 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3724db8b-4925-4204-83fe-9d43238a768f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:31.777362 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3724db8b-4925-4204-83fe-9d43238a768f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:31.777846 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3724db8b-4925-4204-83fe-9d43238a768f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:31.778285 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3724db8b-4925-4204-83fe-9d43238a768f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:31.779010 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3724db8b-4925-4204-83fe-9d43238a768f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:31.779494 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3724db8b-4925-4204-83fe-9d43238a768f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:31.779918 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3724db8b-4925-4204-83fe-9d43238a768f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:31.914179 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3724db8b-4925-4204-83fe-9d43238a768f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:31.922767 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3724db8b-4925-4204-83fe-9d43238a768f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:31.924272 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3724db8b-4925-4204-83fe-9d43238a768f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:31.925424 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3724db8b-4925-4204-83fe-9d43238a768f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.159768 Aug 29 19:07:31.925976 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 326/637] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:31 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:32.948460 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4941894a-4291-4ce2-b25f-bfea3275c023 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:32.949004 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4941894a-4291-4ce2-b25f-bfea3275c023 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:32.951364 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=52 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:32.956570 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4941894a-4291-4ce2-b25f-bfea3275c023 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:32.957052 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4941894a-4291-4ce2-b25f-bfea3275c023 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:32.957484 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4941894a-4291-4ce2-b25f-bfea3275c023 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:32.958167 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4941894a-4291-4ce2-b25f-bfea3275c023 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:32.958619 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4941894a-4291-4ce2-b25f-bfea3275c023 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:32.959074 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4941894a-4291-4ce2-b25f-bfea3275c023 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:33.084828 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4941894a-4291-4ce2-b25f-bfea3275c023 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:33.093465 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4941894a-4291-4ce2-b25f-bfea3275c023 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:33.094898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4941894a-4291-4ce2-b25f-bfea3275c023 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:33.096073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4941894a-4291-4ce2-b25f-bfea3275c023 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.151949 Aug 29 19:07:33.096631 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 312/638] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:32 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:34.120309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bceb1ce0-dd9e-4153-b66b-378cf8696191 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:34.120913 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bceb1ce0-dd9e-4153-b66b-378cf8696191 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:34.127338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bceb1ce0-dd9e-4153-b66b-378cf8696191 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:34.127816 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bceb1ce0-dd9e-4153-b66b-378cf8696191 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:34.128246 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bceb1ce0-dd9e-4153-b66b-378cf8696191 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:34.128923 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bceb1ce0-dd9e-4153-b66b-378cf8696191 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:34.129369 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bceb1ce0-dd9e-4153-b66b-378cf8696191 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:34.129785 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bceb1ce0-dd9e-4153-b66b-378cf8696191 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:34.265239 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bceb1ce0-dd9e-4153-b66b-378cf8696191 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:34.274128 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bceb1ce0-dd9e-4153-b66b-378cf8696191 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:34.275715 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bceb1ce0-dd9e-4153-b66b-378cf8696191 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:34.276875 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bceb1ce0-dd9e-4153-b66b-378cf8696191 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.160438 Aug 29 19:07:34.278343 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 327/639] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:34 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:34.781909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-b0103012-5117-4ed2-86fa-ec27afd48838 req-9aa3fbe7-bffd-4463-a061-7d9c9f53641e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55705ba3-2981-43e1-80e0-29995ee472a9", "name": "network-vif-plugged", "status": "completed", "tag": "e7223967-a4dc-4ee2-8b85-82a153b42231"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:07:34.791864 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-b0103012-5117-4ed2-86fa-ec27afd48838 req-9aa3fbe7-bffd-4463-a061-7d9c9f53641e service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:34.792983 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-b0103012-5117-4ed2-86fa-ec27afd48838 req-9aa3fbe7-bffd-4463-a061-7d9c9f53641e service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:34.793418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-b0103012-5117-4ed2-86fa-ec27afd48838 req-9aa3fbe7-bffd-4463-a061-7d9c9f53641e service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:34.804509 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-b0103012-5117-4ed2-86fa-ec27afd48838 req-9aa3fbe7-bffd-4463-a061-7d9c9f53641e service nova] Creating event network-vif-plugged:e7223967-a4dc-4ee2-8b85-82a153b42231 for instance 55705ba3-2981-43e1-80e0-29995ee472a9 on hv-cinder-85083 Aug 29 19:07:34.809572 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-b0103012-5117-4ed2-86fa-ec27afd48838 req-9aa3fbe7-bffd-4463-a061-7d9c9f53641e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091602 Aug 29 19:07:34.810144 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 313/640] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:07:35.299701 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a421af5a-abb8-42fb-850e-2b1ab7384ea3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:35.300288 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a421af5a-abb8-42fb-850e-2b1ab7384ea3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:35.307332 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a421af5a-abb8-42fb-850e-2b1ab7384ea3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:35.307815 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a421af5a-abb8-42fb-850e-2b1ab7384ea3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:35.308246 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a421af5a-abb8-42fb-850e-2b1ab7384ea3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:35.308954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a421af5a-abb8-42fb-850e-2b1ab7384ea3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:35.309404 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a421af5a-abb8-42fb-850e-2b1ab7384ea3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:35.309820 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a421af5a-abb8-42fb-850e-2b1ab7384ea3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:35.438734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a421af5a-abb8-42fb-850e-2b1ab7384ea3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:35.448282 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a421af5a-abb8-42fb-850e-2b1ab7384ea3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:35.449723 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a421af5a-abb8-42fb-850e-2b1ab7384ea3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:35.450876 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a421af5a-abb8-42fb-850e-2b1ab7384ea3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.155036 Aug 29 19:07:35.451471 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 328/641] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:35 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:36.474449 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f36e93d7-1eae-49a8-ae5e-5b3c045b3507 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:36.475169 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f36e93d7-1eae-49a8-ae5e-5b3c045b3507 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:36.481878 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f36e93d7-1eae-49a8-ae5e-5b3c045b3507 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:36.482354 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f36e93d7-1eae-49a8-ae5e-5b3c045b3507 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:36.482782 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f36e93d7-1eae-49a8-ae5e-5b3c045b3507 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:36.483510 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f36e93d7-1eae-49a8-ae5e-5b3c045b3507 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:36.483957 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f36e93d7-1eae-49a8-ae5e-5b3c045b3507 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:36.484376 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f36e93d7-1eae-49a8-ae5e-5b3c045b3507 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:36.641732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f36e93d7-1eae-49a8-ae5e-5b3c045b3507 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:36.651254 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f36e93d7-1eae-49a8-ae5e-5b3c045b3507 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:36.652804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f36e93d7-1eae-49a8-ae5e-5b3c045b3507 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:36.653970 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f36e93d7-1eae-49a8-ae5e-5b3c045b3507 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.184204 Aug 29 19:07:36.654729 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 314/642] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:36 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:37.676354 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e1ecfeb0-f2da-4372-9371-a5902795e978 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:37.676958 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e1ecfeb0-f2da-4372-9371-a5902795e978 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:37.683737 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1ecfeb0-f2da-4372-9371-a5902795e978 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:37.684211 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1ecfeb0-f2da-4372-9371-a5902795e978 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:37.684639 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1ecfeb0-f2da-4372-9371-a5902795e978 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:37.685329 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1ecfeb0-f2da-4372-9371-a5902795e978 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:37.685776 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1ecfeb0-f2da-4372-9371-a5902795e978 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:37.686192 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1ecfeb0-f2da-4372-9371-a5902795e978 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:37.818559 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e1ecfeb0-f2da-4372-9371-a5902795e978 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:37.828158 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e1ecfeb0-f2da-4372-9371-a5902795e978 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:37.829588 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e1ecfeb0-f2da-4372-9371-a5902795e978 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:37.830754 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e1ecfeb0-f2da-4372-9371-a5902795e978 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.158360 Aug 29 19:07:37.831403 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 329/643] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:37 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:38.853205 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-37b662d2-a68d-4eca-a829-1fb4376e9306 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:38.853820 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-37b662d2-a68d-4eca-a829-1fb4376e9306 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:38.860442 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-37b662d2-a68d-4eca-a829-1fb4376e9306 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:38.860929 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-37b662d2-a68d-4eca-a829-1fb4376e9306 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:38.861362 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-37b662d2-a68d-4eca-a829-1fb4376e9306 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:38.862051 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-37b662d2-a68d-4eca-a829-1fb4376e9306 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:38.862504 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-37b662d2-a68d-4eca-a829-1fb4376e9306 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:38.862927 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-37b662d2-a68d-4eca-a829-1fb4376e9306 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:38.989258 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-37b662d2-a68d-4eca-a829-1fb4376e9306 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:38.998409 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-37b662d2-a68d-4eca-a829-1fb4376e9306 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:38.999878 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-37b662d2-a68d-4eca-a829-1fb4376e9306 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:39.001030 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-37b662d2-a68d-4eca-a829-1fb4376e9306 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.151753 Aug 29 19:07:39.001581 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 315/644] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:38 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:40.024257 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2de01139-441d-49bf-b71f-201e70580226 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:40.024953 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2de01139-441d-49bf-b71f-201e70580226 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:40.031638 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2de01139-441d-49bf-b71f-201e70580226 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:40.032116 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2de01139-441d-49bf-b71f-201e70580226 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:40.032543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2de01139-441d-49bf-b71f-201e70580226 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:40.033252 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2de01139-441d-49bf-b71f-201e70580226 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:40.033697 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2de01139-441d-49bf-b71f-201e70580226 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:40.034114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2de01139-441d-49bf-b71f-201e70580226 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:40.051453 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:40.166063 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2de01139-441d-49bf-b71f-201e70580226 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:40.174650 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2de01139-441d-49bf-b71f-201e70580226 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:40.176172 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2de01139-441d-49bf-b71f-201e70580226 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:40.177332 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2de01139-441d-49bf-b71f-201e70580226 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.157043 Aug 29 19:07:40.177895 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 330/645] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:40 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:41.200966 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a39c9ce0-8d99-4a12-b5c2-88a42d0078df tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:41.201577 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a39c9ce0-8d99-4a12-b5c2-88a42d0078df tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:41.208006 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a39c9ce0-8d99-4a12-b5c2-88a42d0078df tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:41.208490 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a39c9ce0-8d99-4a12-b5c2-88a42d0078df tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:41.208921 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a39c9ce0-8d99-4a12-b5c2-88a42d0078df tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:41.209602 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a39c9ce0-8d99-4a12-b5c2-88a42d0078df tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:41.210048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a39c9ce0-8d99-4a12-b5c2-88a42d0078df tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:41.210467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a39c9ce0-8d99-4a12-b5c2-88a42d0078df tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:41.340618 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a39c9ce0-8d99-4a12-b5c2-88a42d0078df tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:41.349299 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a39c9ce0-8d99-4a12-b5c2-88a42d0078df tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:41.350737 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a39c9ce0-8d99-4a12-b5c2-88a42d0078df tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:41.352609 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a39c9ce0-8d99-4a12-b5c2-88a42d0078df tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.154892 Aug 29 19:07:41.353370 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 316/646] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:41 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:42.375282 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fe838af2-561d-4d2a-8b85-f5bc0522ea30 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:42.375890 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fe838af2-561d-4d2a-8b85-f5bc0522ea30 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:42.382253 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fe838af2-561d-4d2a-8b85-f5bc0522ea30 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:42.382730 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fe838af2-561d-4d2a-8b85-f5bc0522ea30 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:42.383248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fe838af2-561d-4d2a-8b85-f5bc0522ea30 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:42.383926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fe838af2-561d-4d2a-8b85-f5bc0522ea30 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:42.384372 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fe838af2-561d-4d2a-8b85-f5bc0522ea30 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:42.384786 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fe838af2-561d-4d2a-8b85-f5bc0522ea30 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:42.510926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fe838af2-561d-4d2a-8b85-f5bc0522ea30 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:42.519426 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fe838af2-561d-4d2a-8b85-f5bc0522ea30 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:42.520848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fe838af2-561d-4d2a-8b85-f5bc0522ea30 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:42.522133 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fe838af2-561d-4d2a-8b85-f5bc0522ea30 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.150636 Aug 29 19:07:42.522689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 331/647] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:42 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:43.544877 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4dc386d1-026d-4e2c-b14c-759efb963167 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:43.545481 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4dc386d1-026d-4e2c-b14c-759efb963167 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:43.551900 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4dc386d1-026d-4e2c-b14c-759efb963167 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:43.552401 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4dc386d1-026d-4e2c-b14c-759efb963167 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:43.552831 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4dc386d1-026d-4e2c-b14c-759efb963167 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:43.553561 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4dc386d1-026d-4e2c-b14c-759efb963167 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:43.554013 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4dc386d1-026d-4e2c-b14c-759efb963167 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:43.554435 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4dc386d1-026d-4e2c-b14c-759efb963167 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:43.688178 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4dc386d1-026d-4e2c-b14c-759efb963167 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:43.697779 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4dc386d1-026d-4e2c-b14c-759efb963167 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:43.699222 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4dc386d1-026d-4e2c-b14c-759efb963167 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:43.700395 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4dc386d1-026d-4e2c-b14c-759efb963167 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.159485 Aug 29 19:07:43.700983 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 317/648] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:43 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:44.725052 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2c6316ee-99af-4d8b-8e6c-9123b12121e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:44.725657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2c6316ee-99af-4d8b-8e6c-9123b12121e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:44.732204 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c6316ee-99af-4d8b-8e6c-9123b12121e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:44.732759 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c6316ee-99af-4d8b-8e6c-9123b12121e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:44.733219 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c6316ee-99af-4d8b-8e6c-9123b12121e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:44.733981 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c6316ee-99af-4d8b-8e6c-9123b12121e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:44.734430 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c6316ee-99af-4d8b-8e6c-9123b12121e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:44.734844 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c6316ee-99af-4d8b-8e6c-9123b12121e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:44.864183 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2c6316ee-99af-4d8b-8e6c-9123b12121e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:44.872747 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2c6316ee-99af-4d8b-8e6c-9123b12121e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:44.874175 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2c6316ee-99af-4d8b-8e6c-9123b12121e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:44.875342 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2c6316ee-99af-4d8b-8e6c-9123b12121e2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.154137 Aug 29 19:07:44.875896 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 332/649] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:44 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:45.898326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2969c20a-00fe-4be9-aa54-61fa7c41f2ae tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:45.899127 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2969c20a-00fe-4be9-aa54-61fa7c41f2ae tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:45.905235 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2969c20a-00fe-4be9-aa54-61fa7c41f2ae tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:45.905706 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2969c20a-00fe-4be9-aa54-61fa7c41f2ae tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:45.906131 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2969c20a-00fe-4be9-aa54-61fa7c41f2ae tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:45.906806 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2969c20a-00fe-4be9-aa54-61fa7c41f2ae tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:45.907284 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2969c20a-00fe-4be9-aa54-61fa7c41f2ae tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:45.907697 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2969c20a-00fe-4be9-aa54-61fa7c41f2ae tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:45.911716 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:46.037297 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2969c20a-00fe-4be9-aa54-61fa7c41f2ae tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:46.045719 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2969c20a-00fe-4be9-aa54-61fa7c41f2ae tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:46.047201 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2969c20a-00fe-4be9-aa54-61fa7c41f2ae tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:46.048341 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2969c20a-00fe-4be9-aa54-61fa7c41f2ae tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.153989 Aug 29 19:07:46.048882 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 318/650] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:45 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:47.073010 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8692c1e9-185f-4257-86bf-076e2c522953 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:47.073745 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8692c1e9-185f-4257-86bf-076e2c522953 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:47.080186 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8692c1e9-185f-4257-86bf-076e2c522953 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:47.080667 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8692c1e9-185f-4257-86bf-076e2c522953 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:47.081097 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8692c1e9-185f-4257-86bf-076e2c522953 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:47.081784 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8692c1e9-185f-4257-86bf-076e2c522953 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:47.082227 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8692c1e9-185f-4257-86bf-076e2c522953 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:47.082647 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8692c1e9-185f-4257-86bf-076e2c522953 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:47.209281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8692c1e9-185f-4257-86bf-076e2c522953 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:47.218029 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8692c1e9-185f-4257-86bf-076e2c522953 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:47.219503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8692c1e9-185f-4257-86bf-076e2c522953 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:47.220659 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8692c1e9-185f-4257-86bf-076e2c522953 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.152746 Aug 29 19:07:47.221210 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 333/651] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:47 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:48.243391 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-639db723-b75c-492e-bff9-4eba07fb5451 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:48.244034 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-639db723-b75c-492e-bff9-4eba07fb5451 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:48.249937 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-639db723-b75c-492e-bff9-4eba07fb5451 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:48.250419 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-639db723-b75c-492e-bff9-4eba07fb5451 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:48.250860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-639db723-b75c-492e-bff9-4eba07fb5451 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:48.251566 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-639db723-b75c-492e-bff9-4eba07fb5451 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:48.252020 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-639db723-b75c-492e-bff9-4eba07fb5451 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:48.252440 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-639db723-b75c-492e-bff9-4eba07fb5451 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:48.386234 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-639db723-b75c-492e-bff9-4eba07fb5451 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:48.394896 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-639db723-b75c-492e-bff9-4eba07fb5451 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:48.396368 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-639db723-b75c-492e-bff9-4eba07fb5451 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:48.397521 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-639db723-b75c-492e-bff9-4eba07fb5451 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.157921 Aug 29 19:07:48.398065 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 319/652] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:48 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:49.421200 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5611cc8a-2a1a-468b-a120-6aa61676f03f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:49.421849 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5611cc8a-2a1a-468b-a120-6aa61676f03f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:49.430434 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5611cc8a-2a1a-468b-a120-6aa61676f03f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:49.431018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5611cc8a-2a1a-468b-a120-6aa61676f03f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:49.431296 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5611cc8a-2a1a-468b-a120-6aa61676f03f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:49.432005 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5611cc8a-2a1a-468b-a120-6aa61676f03f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:49.432460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5611cc8a-2a1a-468b-a120-6aa61676f03f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:49.432880 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5611cc8a-2a1a-468b-a120-6aa61676f03f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:49.576482 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5611cc8a-2a1a-468b-a120-6aa61676f03f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:49.588257 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5611cc8a-2a1a-468b-a120-6aa61676f03f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:49.589741 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5611cc8a-2a1a-468b-a120-6aa61676f03f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:49.590903 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5611cc8a-2a1a-468b-a120-6aa61676f03f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1808 microversion: 2.20 time: 0.173680 Aug 29 19:07:49.604406 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 334/653] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:49 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:50.615650 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-13542553-2707-4ef2-abb2-1233373addc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:50.616261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-13542553-2707-4ef2-abb2-1233373addc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:50.622703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13542553-2707-4ef2-abb2-1233373addc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:50.623166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13542553-2707-4ef2-abb2-1233373addc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:50.623606 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13542553-2707-4ef2-abb2-1233373addc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:50.624289 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13542553-2707-4ef2-abb2-1233373addc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:50.624740 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13542553-2707-4ef2-abb2-1233373addc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:50.625197 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13542553-2707-4ef2-abb2-1233373addc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:50.759870 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-13542553-2707-4ef2-abb2-1233373addc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:50.769170 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-13542553-2707-4ef2-abb2-1233373addc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:50.770612 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-13542553-2707-4ef2-abb2-1233373addc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:50.771803 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-13542553-2707-4ef2-abb2-1233373addc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1795 microversion: 2.20 time: 0.160035 Aug 29 19:07:50.772351 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 320/654] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:07:50 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1795 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:07:52.604493 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a1494d8b-16e7-43b5-842d-74cabf176e4c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:52.604980 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a1494d8b-16e7-43b5-842d-74cabf176e4c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:52.611624 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1494d8b-16e7-43b5-842d-74cabf176e4c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:52.612108 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1494d8b-16e7-43b5-842d-74cabf176e4c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:52.612535 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1494d8b-16e7-43b5-842d-74cabf176e4c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:52.613213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1494d8b-16e7-43b5-842d-74cabf176e4c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:52.613667 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1494d8b-16e7-43b5-842d-74cabf176e4c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:52.614084 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1494d8b-16e7-43b5-842d-74cabf176e4c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:52.695976 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-a1494d8b-16e7-43b5-842d-74cabf176e4c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lazy-loading 'services' on Instance uuid bdcafad1-7223-493c-bb5f-b719847aeb1e {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:07:52.769840 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a1494d8b-16e7-43b5-842d-74cabf176e4c tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "DELETE /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e/os-volume_attachments/03008f16-37da-4391-8d16-9b912342892a" status: 202 len: 0 microversion: 2.1 time: 0.169371 Aug 29 19:07:52.770624 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 335/655] 10.222.0.86 () {58 vars in 1416 bytes} [Mon Aug 29 19:07:52 2022] DELETE /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e/os-volume_attachments/03008f16-37da-4391-8d16-9b912342892a => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:07:53.889245 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1b85955e-6c91-48e1-bafc-ea745d9db341 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:53.890093 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1b85955e-6c91-48e1-bafc-ea745d9db341 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:53.901349 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b85955e-6c91-48e1-bafc-ea745d9db341 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:53.902199 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b85955e-6c91-48e1-bafc-ea745d9db341 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:53.903006 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b85955e-6c91-48e1-bafc-ea745d9db341 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:53.904251 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b85955e-6c91-48e1-bafc-ea745d9db341 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:53.904965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b85955e-6c91-48e1-bafc-ea745d9db341 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:53.905550 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b85955e-6c91-48e1-bafc-ea745d9db341 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:53.933396 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1b85955e-6c91-48e1-bafc-ea745d9db341 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:07:54.007706 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1b85955e-6c91-48e1-bafc-ea745d9db341 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "DELETE /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 204 len: 0 microversion: 2.1 time: 0.123770 Aug 29 19:07:54.008277 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 321/656] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:07:53 2022] DELETE /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:07:54.017523 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a2be22aa-71a1-4106-9061-27bdcdd9b3ed tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:54.018232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a2be22aa-71a1-4106-9061-27bdcdd9b3ed tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:54.024381 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a2be22aa-71a1-4106-9061-27bdcdd9b3ed tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:54.025486 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a2be22aa-71a1-4106-9061-27bdcdd9b3ed tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:54.025812 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a2be22aa-71a1-4106-9061-27bdcdd9b3ed tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:54.026531 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a2be22aa-71a1-4106-9061-27bdcdd9b3ed tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:54.027046 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a2be22aa-71a1-4106-9061-27bdcdd9b3ed tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:54.027430 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a2be22aa-71a1-4106-9061-27bdcdd9b3ed tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:54.163586 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a2be22aa-71a1-4106-9061-27bdcdd9b3ed tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:54.171795 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a2be22aa-71a1-4106-9061-27bdcdd9b3ed tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1512 microversion: 2.1 time: 0.158923 Aug 29 19:07:54.172368 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 336/657] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:54 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:55.193642 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-654da6bc-972a-488f-81a8-573557887ff4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:55.194374 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-654da6bc-972a-488f-81a8-573557887ff4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:55.201255 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-654da6bc-972a-488f-81a8-573557887ff4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:55.201743 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-654da6bc-972a-488f-81a8-573557887ff4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:55.202174 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-654da6bc-972a-488f-81a8-573557887ff4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:55.202862 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-654da6bc-972a-488f-81a8-573557887ff4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:55.203344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-654da6bc-972a-488f-81a8-573557887ff4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:55.203766 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-654da6bc-972a-488f-81a8-573557887ff4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:55.331707 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-654da6bc-972a-488f-81a8-573557887ff4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:55.339796 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-654da6bc-972a-488f-81a8-573557887ff4 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1512 microversion: 2.1 time: 0.150464 Aug 29 19:07:55.340360 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 322/658] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:55 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:56.361327 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-36425e1e-8b9a-413a-95c2-9113c71854e0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:56.361867 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-36425e1e-8b9a-413a-95c2-9113c71854e0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:56.368242 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36425e1e-8b9a-413a-95c2-9113c71854e0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:56.368720 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36425e1e-8b9a-413a-95c2-9113c71854e0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:56.369145 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36425e1e-8b9a-413a-95c2-9113c71854e0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:56.369820 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36425e1e-8b9a-413a-95c2-9113c71854e0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:56.370268 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36425e1e-8b9a-413a-95c2-9113c71854e0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:56.370686 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36425e1e-8b9a-413a-95c2-9113c71854e0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:56.500189 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-36425e1e-8b9a-413a-95c2-9113c71854e0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:56.507967 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-36425e1e-8b9a-413a-95c2-9113c71854e0 tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1512 microversion: 2.1 time: 0.150701 Aug 29 19:07:56.508529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 337/659] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:56 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:56.997179 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-a19a5195-84cf-41cf-b812-70b84c4c4f03 req-bc669000-892b-41a8-897b-d09a88857e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdcafad1-7223-493c-bb5f-b719847aeb1e", "name": "network-vif-deleted", "tag": "53b26cbc-aca0-44fa-b15f-401c8ad8edf3"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:07:57.007287 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-a19a5195-84cf-41cf-b812-70b84c4c4f03 req-bc669000-892b-41a8-897b-d09a88857e12 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:57.007759 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-a19a5195-84cf-41cf-b812-70b84c4c4f03 req-bc669000-892b-41a8-897b-d09a88857e12 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:57.008187 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-a19a5195-84cf-41cf-b812-70b84c4c4f03 req-bc669000-892b-41a8-897b-d09a88857e12 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:57.019489 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-a19a5195-84cf-41cf-b812-70b84c4c4f03 req-bc669000-892b-41a8-897b-d09a88857e12 service nova] Creating event network-vif-deleted:53b26cbc-aca0-44fa-b15f-401c8ad8edf3 for instance bdcafad1-7223-493c-bb5f-b719847aeb1e on hv-cinder-85083 Aug 29 19:07:57.024546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-a19a5195-84cf-41cf-b812-70b84c4c4f03 req-bc669000-892b-41a8-897b-d09a88857e12 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087665 Aug 29 19:07:57.025773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 323/660] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:07:57.528489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ecf67ba6-ec60-427d-ae0c-e9ccfdbb20dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:57.529131 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ecf67ba6-ec60-427d-ae0c-e9ccfdbb20dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:57.535542 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ecf67ba6-ec60-427d-ae0c-e9ccfdbb20dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:57.536033 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ecf67ba6-ec60-427d-ae0c-e9ccfdbb20dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:57.536472 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ecf67ba6-ec60-427d-ae0c-e9ccfdbb20dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:57.537266 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ecf67ba6-ec60-427d-ae0c-e9ccfdbb20dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:57.537722 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ecf67ba6-ec60-427d-ae0c-e9ccfdbb20dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:57.538151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ecf67ba6-ec60-427d-ae0c-e9ccfdbb20dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:57.571329 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ecf67ba6-ec60-427d-ae0c-e9ccfdbb20dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:57.571816 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ecf67ba6-ec60-427d-ae0c-e9ccfdbb20dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:57.572252 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ecf67ba6-ec60-427d-ae0c-e9ccfdbb20dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:57.572699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-ecf67ba6-ec60-427d-ae0c-e9ccfdbb20dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lazy-loading 'fault' on Instance uuid bdcafad1-7223-493c-bb5f-b719847aeb1e {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:07:57.613031 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ecf67ba6-ec60-427d-ae0c-e9ccfdbb20dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e853439341466dbea3a535ca13d12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7918fb7f8aea4f58857307485bc09ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:57.621366 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ecf67ba6-ec60-427d-ae0c-e9ccfdbb20dd tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 200 len: 1308 microversion: 2.1 time: 0.096775 Aug 29 19:07:57.622064 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 338/661] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:57 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:58.644893 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-127297e2-15dd-414b-91bf-873456c5bdad tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:58.645588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-127297e2-15dd-414b-91bf-873456c5bdad tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] [instance: bdcafad1-7223-493c-bb5f-b719847aeb1e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:58.652104 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-127297e2-15dd-414b-91bf-873456c5bdad tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:58.652580 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-127297e2-15dd-414b-91bf-873456c5bdad tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:58.653006 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-127297e2-15dd-414b-91bf-873456c5bdad tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:58.653689 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-127297e2-15dd-414b-91bf-873456c5bdad tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:58.654181 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-127297e2-15dd-414b-91bf-873456c5bdad tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:58.654577 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-127297e2-15dd-414b-91bf-873456c5bdad tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:58.668288 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-127297e2-15dd-414b-91bf-873456c5bdad tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] HTTP exception thrown: Instance bdcafad1-7223-493c-bb5f-b719847aeb1e could not be found. Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-127297e2-15dd-414b-91bf-873456c5bdad tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Request method failure captured: Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e HTTP/1.1 Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ3EefqZxFsH_ahFuqGL6v_BH8X2FXmx8UPjy5RW0BlVYtEl0fZrDwXUSc6cUr2FrsfNi8rjCQ8pvpY9jfpO3LWkuxh15JG6rfKIxjPdYCMkmCyaSaLcRCwjL78v3MCCBq5SBXqTsfKnlTdZC39mGrxaNzSR7E50S4LBzbp4Ytw7lHQ Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 7918fb7f8aea4f58857307485bc09ec6 Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesSnapshotTestJSON-291539592 Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:07:58.669898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:07:58.671497 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7918fb7f8aea4f58857307485bc09ec6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/7918fb7f8aea4f58857307485bc09ec6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/7918fb7f8aea4f58857307485bc09ec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_7918fb7f8aea4f58857307485bc09ec6"}]}] Aug 29 19:07:58.671497 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesSnapshotTestJSON-291539592 Aug 29 19:07:58.671497 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 7918fb7f8aea4f58857307485bc09ec6 Aug 29 19:07:58.671497 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-291539592 Aug 29 19:07:58.671497 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesSnapshotTestJSON-291539592-project Aug 29 19:07:58.671497 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:07:58.671497 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:07:58.671497 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: 98e853439341466dbea3a535ca13d12b Aug 29 19:07:58.671497 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesSnapshotTestJSON-291539592-project Aug 29 19:07:58.671497 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:07:58.671497 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance bdcafad1-7223-493c-bb5f-b719847aeb1e could not be found. Aug 29 19:07:58.671497 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': 'bdcafad1-7223-493c-bb5f-b719847aeb1e'} Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdcafad1-7223-493c-bb5f-b719847aeb1e could not be found. Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:07:58.672344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdcafad1-7223-493c-bb5f-b719847aeb1e could not be found. Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdcafad1-7223-493c-bb5f-b719847aeb1e could not be found. Aug 29 19:07:58.673840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:07:58.675218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-127297e2-15dd-414b-91bf-873456c5bdad tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] Returning 404 to user: Instance bdcafad1-7223-493c-bb5f-b719847aeb1e could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:07:58.675218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-127297e2-15dd-414b-91bf-873456c5bdad tempest-VolumesSnapshotTestJSON-291539592 tempest-VolumesSnapshotTestJSON-291539592-project] 10.222.0.86 "GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e" status: 404 len: 111 microversion: 2.1 time: 0.031228 Aug 29 19:07:58.675218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 324/662] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:58 2022] GET /compute/v2.1/servers/bdcafad1-7223-493c-bb5f-b719847aeb1e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:08:17.160037 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=29 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:17.160756 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:17.258190 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-014eaab5-7850-4bc2-84fd-163aca019448 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1284e0d2-8329-4967-8cdb-905198ae8ea1"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:17.261161 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-014eaab5-7850-4bc2-84fd-163aca019448 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:17.267055 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-014eaab5-7850-4bc2-84fd-163aca019448 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:17.267535 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-014eaab5-7850-4bc2-84fd-163aca019448 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:17.267963 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-014eaab5-7850-4bc2-84fd-163aca019448 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:17.268635 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-014eaab5-7850-4bc2-84fd-163aca019448 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:17.269080 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-014eaab5-7850-4bc2-84fd-163aca019448 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:17.269497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-014eaab5-7850-4bc2-84fd-163aca019448 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:17.536821 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-014eaab5-7850-4bc2-84fd-163aca019448 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "POST /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381452 Aug 29 19:08:17.537498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 339/663] 10.222.0.86 () {60 vars in 1323 bytes} [Mon Aug 29 19:08:17 2022] POST /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:08:25.078511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-438045b0-e0e2-4370-a01d-78dbdacc87bc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:25.080698 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-438045b0-e0e2-4370-a01d-78dbdacc87bc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:25.082967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:25.083631 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:25.089936 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-438045b0-e0e2-4370-a01d-78dbdacc87bc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:25.090415 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-438045b0-e0e2-4370-a01d-78dbdacc87bc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:25.090848 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-438045b0-e0e2-4370-a01d-78dbdacc87bc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:25.091558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-438045b0-e0e2-4370-a01d-78dbdacc87bc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:25.092004 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-438045b0-e0e2-4370-a01d-78dbdacc87bc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:25.092419 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-438045b0-e0e2-4370-a01d-78dbdacc87bc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:25.116458 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-438045b0-e0e2-4370-a01d-78dbdacc87bc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lazy-loading 'flavor' on Instance uuid 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:08:25.276387 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-438045b0-e0e2-4370-a01d-78dbdacc87bc tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "POST /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/action" status: 200 len: 32 microversion: 2.1 time: 0.201601 Aug 29 19:08:25.276971 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 325/664] 10.222.0.86 () {60 vars in 1278 bytes} [Mon Aug 29 19:08:25 2022] POST /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:08:25.294331 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fa4981c8-41cc-4b60-bbf9-ba9d30307806 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:25.295364 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fa4981c8-41cc-4b60-bbf9-ba9d30307806 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:25.303409 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa4981c8-41cc-4b60-bbf9-ba9d30307806 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:25.304283 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa4981c8-41cc-4b60-bbf9-ba9d30307806 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:25.305071 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa4981c8-41cc-4b60-bbf9-ba9d30307806 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:25.305911 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa4981c8-41cc-4b60-bbf9-ba9d30307806 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:25.306375 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa4981c8-41cc-4b60-bbf9-ba9d30307806 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:25.306801 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa4981c8-41cc-4b60-bbf9-ba9d30307806 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:25.450870 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fa4981c8-41cc-4b60-bbf9-ba9d30307806 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:25.459266 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fa4981c8-41cc-4b60-bbf9-ba9d30307806 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1735 microversion: 2.1 time: 0.175773 Aug 29 19:08:25.459855 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 340/665] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:25 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:26.483833 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0050a055-0009-4754-bce4-699e323f1522 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:26.484656 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0050a055-0009-4754-bce4-699e323f1522 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:26.494009 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0050a055-0009-4754-bce4-699e323f1522 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:26.495130 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0050a055-0009-4754-bce4-699e323f1522 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:26.495565 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0050a055-0009-4754-bce4-699e323f1522 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:26.496252 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0050a055-0009-4754-bce4-699e323f1522 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:26.496697 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0050a055-0009-4754-bce4-699e323f1522 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:26.497116 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0050a055-0009-4754-bce4-699e323f1522 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:26.628533 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0050a055-0009-4754-bce4-699e323f1522 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:26.637287 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0050a055-0009-4754-bce4-699e323f1522 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1735 microversion: 2.1 time: 0.159332 Aug 29 19:08:26.637841 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 326/666] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:26 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:27.657532 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d6fb5539-3507-4802-a647-c58464812cea tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:27.658408 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d6fb5539-3507-4802-a647-c58464812cea tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:27.667800 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6fb5539-3507-4802-a647-c58464812cea tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:27.668541 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6fb5539-3507-4802-a647-c58464812cea tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:27.669158 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6fb5539-3507-4802-a647-c58464812cea tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:27.670151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6fb5539-3507-4802-a647-c58464812cea tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:27.670890 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6fb5539-3507-4802-a647-c58464812cea tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:27.672204 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6fb5539-3507-4802-a647-c58464812cea tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:27.812664 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d6fb5539-3507-4802-a647-c58464812cea tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:27.821932 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d6fb5539-3507-4802-a647-c58464812cea tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1735 microversion: 2.1 time: 0.167455 Aug 29 19:08:27.822491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 341/667] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:27 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:28.843327 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3cfbb0e6-2251-4b31-930b-b949691920d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:28.844060 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3cfbb0e6-2251-4b31-930b-b949691920d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:28.850623 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3cfbb0e6-2251-4b31-930b-b949691920d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:28.851128 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3cfbb0e6-2251-4b31-930b-b949691920d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:28.851559 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3cfbb0e6-2251-4b31-930b-b949691920d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:28.852245 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3cfbb0e6-2251-4b31-930b-b949691920d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:28.852779 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3cfbb0e6-2251-4b31-930b-b949691920d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:28.853238 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3cfbb0e6-2251-4b31-930b-b949691920d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:28.991457 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3cfbb0e6-2251-4b31-930b-b949691920d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:29.000614 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3cfbb0e6-2251-4b31-930b-b949691920d0 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1735 microversion: 2.1 time: 0.161064 Aug 29 19:08:29.001292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 327/668] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:28 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:30.021820 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a151791c-545e-4d4c-93da-7da40f07d4ed tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:30.023278 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a151791c-545e-4d4c-93da-7da40f07d4ed tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:30.030588 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a151791c-545e-4d4c-93da-7da40f07d4ed tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:30.031390 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a151791c-545e-4d4c-93da-7da40f07d4ed tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:30.032005 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a151791c-545e-4d4c-93da-7da40f07d4ed tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:30.032887 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a151791c-545e-4d4c-93da-7da40f07d4ed tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:30.033498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a151791c-545e-4d4c-93da-7da40f07d4ed tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:30.034080 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a151791c-545e-4d4c-93da-7da40f07d4ed tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:30.310711 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a151791c-545e-4d4c-93da-7da40f07d4ed tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:30.328841 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a151791c-545e-4d4c-93da-7da40f07d4ed tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1735 microversion: 2.1 time: 0.310629 Aug 29 19:08:30.343397 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 342/669] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:30 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1735 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:31.354157 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d3d46acf-c7b4-4161-accf-f6eef3d4405e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:31.355597 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d3d46acf-c7b4-4161-accf-f6eef3d4405e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:31.368894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3d46acf-c7b4-4161-accf-f6eef3d4405e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:31.370110 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3d46acf-c7b4-4161-accf-f6eef3d4405e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:31.370902 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3d46acf-c7b4-4161-accf-f6eef3d4405e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:31.372252 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3d46acf-c7b4-4161-accf-f6eef3d4405e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:31.372934 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3d46acf-c7b4-4161-accf-f6eef3d4405e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:31.373569 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3d46acf-c7b4-4161-accf-f6eef3d4405e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:31.629610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d3d46acf-c7b4-4161-accf-f6eef3d4405e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:31.644038 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d3d46acf-c7b4-4161-accf-f6eef3d4405e tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1735 microversion: 2.1 time: 0.295445 Aug 29 19:08:31.645841 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 328/670] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:31 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1735 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:32.666320 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-54ce5786-e4bf-4854-ad93-8a144ff282f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:32.667659 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-54ce5786-e4bf-4854-ad93-8a144ff282f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:32.674500 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54ce5786-e4bf-4854-ad93-8a144ff282f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:32.675768 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54ce5786-e4bf-4854-ad93-8a144ff282f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:32.676377 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54ce5786-e4bf-4854-ad93-8a144ff282f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:32.677279 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54ce5786-e4bf-4854-ad93-8a144ff282f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:32.677907 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54ce5786-e4bf-4854-ad93-8a144ff282f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:32.678483 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54ce5786-e4bf-4854-ad93-8a144ff282f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:32.930618 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-54ce5786-e4bf-4854-ad93-8a144ff282f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:32.939974 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-54ce5786-e4bf-4854-ad93-8a144ff282f9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1735 microversion: 2.1 time: 0.278034 Aug 29 19:08:32.940869 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 343/671] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:32 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1735 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:33.969593 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6e019604-c61a-4ec3-a2d2-240514e1a3d9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:33.970047 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6e019604-c61a-4ec3-a2d2-240514e1a3d9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:33.977306 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e019604-c61a-4ec3-a2d2-240514e1a3d9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:33.978584 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e019604-c61a-4ec3-a2d2-240514e1a3d9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:33.979295 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e019604-c61a-4ec3-a2d2-240514e1a3d9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:33.980283 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e019604-c61a-4ec3-a2d2-240514e1a3d9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:33.980898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e019604-c61a-4ec3-a2d2-240514e1a3d9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:33.981483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e019604-c61a-4ec3-a2d2-240514e1a3d9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:34.162185 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6e019604-c61a-4ec3-a2d2-240514e1a3d9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:34.171512 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6e019604-c61a-4ec3-a2d2-240514e1a3d9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1735 microversion: 2.1 time: 0.205822 Aug 29 19:08:34.172306 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 329/672] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:33 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:34.392357 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2ff7374d-ea03-452e-a0eb-afff8fc0bfd5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:34.393435 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2ff7374d-ea03-452e-a0eb-afff8fc0bfd5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:34.405256 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ff7374d-ea03-452e-a0eb-afff8fc0bfd5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:34.406149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ff7374d-ea03-452e-a0eb-afff8fc0bfd5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:34.407138 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ff7374d-ea03-452e-a0eb-afff8fc0bfd5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:34.409892 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ff7374d-ea03-452e-a0eb-afff8fc0bfd5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:34.410595 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ff7374d-ea03-452e-a0eb-afff8fc0bfd5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:34.413832 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ff7374d-ea03-452e-a0eb-afff8fc0bfd5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:34.514974 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-2ff7374d-ea03-452e-a0eb-afff8fc0bfd5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lazy-loading 'services' on Instance uuid 4429ad44-4714-483b-b5b3-0091aabe6905 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:08:34.607977 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2ff7374d-ea03-452e-a0eb-afff8fc0bfd5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "DELETE /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/os-volume_attachments/6fe39ad5-31c5-4d08-81fa-bab443971a3e" status: 202 len: 0 microversion: 2.1 time: 0.555170 Aug 29 19:08:34.625061 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 344/673] 10.222.0.86 () {58 vars in 1416 bytes} [Mon Aug 29 19:08:34 2022] DELETE /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/os-volume_attachments/6fe39ad5-31c5-4d08-81fa-bab443971a3e => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:08:35.207618 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3e51fe4b-6e90-4f82-850f-057f7cb88a69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:35.219987 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3e51fe4b-6e90-4f82-850f-057f7cb88a69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:35.233349 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e51fe4b-6e90-4f82-850f-057f7cb88a69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:35.233767 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e51fe4b-6e90-4f82-850f-057f7cb88a69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:35.234202 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e51fe4b-6e90-4f82-850f-057f7cb88a69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:35.234907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e51fe4b-6e90-4f82-850f-057f7cb88a69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:35.237225 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e51fe4b-6e90-4f82-850f-057f7cb88a69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:35.239336 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e51fe4b-6e90-4f82-850f-057f7cb88a69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:35.475628 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3e51fe4b-6e90-4f82-850f-057f7cb88a69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:35.488075 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3e51fe4b-6e90-4f82-850f-057f7cb88a69 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1735 microversion: 2.1 time: 0.296662 Aug 29 19:08:35.489405 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 330/674] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:35 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1735 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:35.767460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-99a5be7b-94d8-4187-8329-86dbbd4f2049 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:35.781037 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99a5be7b-94d8-4187-8329-86dbbd4f2049 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:35.782454 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99a5be7b-94d8-4187-8329-86dbbd4f2049 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:35.783173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99a5be7b-94d8-4187-8329-86dbbd4f2049 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:35.817916 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-99a5be7b-94d8-4187-8329-86dbbd4f2049 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Going to try to stop instance {{(pid=120707) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 19:08:35.896136 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-99a5be7b-94d8-4187-8329-86dbbd4f2049 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "POST /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/action" status: 202 len: 0 microversion: 2.1 time: 0.136615 Aug 29 19:08:35.897389 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 345/675] 10.222.0.86 () {60 vars in 1278 bytes} [Mon Aug 29 19:08:35 2022] POST /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:08:35.906703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f5a9f29d-d3d5-463d-9673-71cfee64cf6d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:35.907473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f5a9f29d-d3d5-463d-9673-71cfee64cf6d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:35.915712 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f5a9f29d-d3d5-463d-9673-71cfee64cf6d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:35.916937 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f5a9f29d-d3d5-463d-9673-71cfee64cf6d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:35.917575 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f5a9f29d-d3d5-463d-9673-71cfee64cf6d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:35.918649 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f5a9f29d-d3d5-463d-9673-71cfee64cf6d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:35.920758 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f5a9f29d-d3d5-463d-9673-71cfee64cf6d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:35.922225 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f5a9f29d-d3d5-463d-9673-71cfee64cf6d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:36.186665 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f5a9f29d-d3d5-463d-9673-71cfee64cf6d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:36.195344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f5a9f29d-d3d5-463d-9673-71cfee64cf6d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1676 microversion: 2.1 time: 0.293170 Aug 29 19:08:36.200513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 331/676] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:35 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1676 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:36.511508 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8fa993b2-6ae4-44c0-9437-085758eb8029 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:36.512474 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8fa993b2-6ae4-44c0-9437-085758eb8029 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:36.519017 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fa993b2-6ae4-44c0-9437-085758eb8029 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:36.519517 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fa993b2-6ae4-44c0-9437-085758eb8029 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:36.520150 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fa993b2-6ae4-44c0-9437-085758eb8029 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:36.521164 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fa993b2-6ae4-44c0-9437-085758eb8029 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:36.521787 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fa993b2-6ae4-44c0-9437-085758eb8029 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:36.522574 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fa993b2-6ae4-44c0-9437-085758eb8029 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:36.703320 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8fa993b2-6ae4-44c0-9437-085758eb8029 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:36.712700 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8fa993b2-6ae4-44c0-9437-085758eb8029 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1735 microversion: 2.1 time: 0.206252 Aug 29 19:08:36.729961 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 346/677] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:36 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:37.229205 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-da2e34bf-691f-4e9e-b57d-c1cb19f4f758 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:37.230341 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-da2e34bf-691f-4e9e-b57d-c1cb19f4f758 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:37.237747 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-da2e34bf-691f-4e9e-b57d-c1cb19f4f758 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:37.238491 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-da2e34bf-691f-4e9e-b57d-c1cb19f4f758 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:37.239139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-da2e34bf-691f-4e9e-b57d-c1cb19f4f758 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:37.240072 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-da2e34bf-691f-4e9e-b57d-c1cb19f4f758 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:37.240529 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-da2e34bf-691f-4e9e-b57d-c1cb19f4f758 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:37.240948 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-da2e34bf-691f-4e9e-b57d-c1cb19f4f758 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:37.401239 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-da2e34bf-691f-4e9e-b57d-c1cb19f4f758 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:37.415829 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-da2e34bf-691f-4e9e-b57d-c1cb19f4f758 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1676 microversion: 2.1 time: 0.189909 Aug 29 19:08:37.417519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 332/678] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:37 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1676 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:37.736826 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1150b43d-3e48-4cc5-898f-e598547b26d7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:37.736826 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1150b43d-3e48-4cc5-898f-e598547b26d7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:37.743175 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1150b43d-3e48-4cc5-898f-e598547b26d7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:37.743643 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1150b43d-3e48-4cc5-898f-e598547b26d7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:37.744080 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1150b43d-3e48-4cc5-898f-e598547b26d7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:37.744778 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1150b43d-3e48-4cc5-898f-e598547b26d7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:37.745264 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1150b43d-3e48-4cc5-898f-e598547b26d7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:37.745639 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1150b43d-3e48-4cc5-898f-e598547b26d7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:37.885781 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1150b43d-3e48-4cc5-898f-e598547b26d7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:37.894428 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1150b43d-3e48-4cc5-898f-e598547b26d7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1735 microversion: 2.1 time: 0.161961 Aug 29 19:08:37.895024 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 347/679] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:37 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:38.437319 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-22cdfdba-a9ac-4d64-b50b-db24b9c0c258 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:38.440369 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-22cdfdba-a9ac-4d64-b50b-db24b9c0c258 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:38.449154 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-22cdfdba-a9ac-4d64-b50b-db24b9c0c258 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:38.449921 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-22cdfdba-a9ac-4d64-b50b-db24b9c0c258 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:38.451159 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-22cdfdba-a9ac-4d64-b50b-db24b9c0c258 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:38.452115 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-22cdfdba-a9ac-4d64-b50b-db24b9c0c258 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:38.452788 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-22cdfdba-a9ac-4d64-b50b-db24b9c0c258 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:38.453427 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-22cdfdba-a9ac-4d64-b50b-db24b9c0c258 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:38.623255 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4040ef10-eed0-415a-b4cb-ab397f2e35e6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Action: 'create', calling method: .version_select at 0x7fb2bd6f9820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-950876423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk4gBFdB6iJxNxCWPakNmCqdxmYsGjtopXp53Bxn6RTA599y3lDOLERfGRWEH3gv18ssdDVseL7HQS5pvOXHQYp8S+jt50bWCZdfWP90+28kEcIvVD4QQ9PkVTQFzQJeQ=="}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:38.640612 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-4040ef10-eed0-415a-b4cb-ab397f2e35e6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Getting quotas for project 5d70fdff5c5a443b9f0ae1a24dfffcd3. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:08:38.645591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-4040ef10-eed0-415a-b4cb-ab397f2e35e6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Getting quotas for user 0547f15d00f043b99de10f3db7348c62 and project 5d70fdff5c5a443b9f0ae1a24dfffcd3. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:08:38.697905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-22cdfdba-a9ac-4d64-b50b-db24b9c0c258 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:38.708537 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-22cdfdba-a9ac-4d64-b50b-db24b9c0c258 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1676 microversion: 2.1 time: 0.274860 Aug 29 19:08:38.709131 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 348/680] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:38 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1676 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:38.744317 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4040ef10-eed0-415a-b4cb-ab397f2e35e6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.314663 Aug 29 19:08:38.745265 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 333/681] 10.222.0.86 () {60 vars in 1159 bytes} [Mon Aug 29 19:08:38 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:38.916302 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ef93b17c-874a-4a11-815e-b285efac6ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:38.916833 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ef93b17c-874a-4a11-815e-b285efac6ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:38.923579 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef93b17c-874a-4a11-815e-b285efac6ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:38.924344 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef93b17c-874a-4a11-815e-b285efac6ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:38.924986 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef93b17c-874a-4a11-815e-b285efac6ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:38.925897 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef93b17c-874a-4a11-815e-b285efac6ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:38.926525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef93b17c-874a-4a11-815e-b285efac6ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:38.927317 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef93b17c-874a-4a11-815e-b285efac6ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:39.088024 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ef93b17c-874a-4a11-815e-b285efac6ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:39.097004 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ef93b17c-874a-4a11-815e-b285efac6ba4 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1735 microversion: 2.1 time: 0.185064 Aug 29 19:08:39.104385 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 349/682] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:38 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:39.735914 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a2a08a35-ae31-481e-b90b-e7013c46e8d8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:39.736634 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a2a08a35-ae31-481e-b90b-e7013c46e8d8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:39.744573 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a2a08a35-ae31-481e-b90b-e7013c46e8d8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:39.745055 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a2a08a35-ae31-481e-b90b-e7013c46e8d8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:39.745487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a2a08a35-ae31-481e-b90b-e7013c46e8d8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:39.746298 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a2a08a35-ae31-481e-b90b-e7013c46e8d8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:39.747084 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a2a08a35-ae31-481e-b90b-e7013c46e8d8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:39.747522 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a2a08a35-ae31-481e-b90b-e7013c46e8d8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:39.942263 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a2a08a35-ae31-481e-b90b-e7013c46e8d8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:39.952748 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a2a08a35-ae31-481e-b90b-e7013c46e8d8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1676 microversion: 2.1 time: 0.223301 Aug 29 19:08:39.954212 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 334/683] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:39 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:40.118102 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e3cad512-abf7-4273-95dc-9117c0b1c790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:40.118883 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e3cad512-abf7-4273-95dc-9117c0b1c790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:40.128028 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e3cad512-abf7-4273-95dc-9117c0b1c790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:40.128591 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e3cad512-abf7-4273-95dc-9117c0b1c790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:40.129089 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e3cad512-abf7-4273-95dc-9117c0b1c790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:40.130037 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e3cad512-abf7-4273-95dc-9117c0b1c790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:40.130667 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e3cad512-abf7-4273-95dc-9117c0b1c790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:40.131156 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e3cad512-abf7-4273-95dc-9117c0b1c790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:40.281408 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e3cad512-abf7-4273-95dc-9117c0b1c790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:40.290615 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e3cad512-abf7-4273-95dc-9117c0b1c790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1735 microversion: 2.1 time: 0.176677 Aug 29 19:08:40.291418 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 350/684] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:40 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:40.976181 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-69ee9f34-b4a0-4c65-be27-4bbca6ae0233 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:40.976727 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-69ee9f34-b4a0-4c65-be27-4bbca6ae0233 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:40.983727 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69ee9f34-b4a0-4c65-be27-4bbca6ae0233 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:40.984202 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69ee9f34-b4a0-4c65-be27-4bbca6ae0233 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:40.984625 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69ee9f34-b4a0-4c65-be27-4bbca6ae0233 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:40.985314 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69ee9f34-b4a0-4c65-be27-4bbca6ae0233 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:40.985759 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69ee9f34-b4a0-4c65-be27-4bbca6ae0233 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:40.986171 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69ee9f34-b4a0-4c65-be27-4bbca6ae0233 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:41.136202 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-69ee9f34-b4a0-4c65-be27-4bbca6ae0233 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:41.145844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-69ee9f34-b4a0-4c65-be27-4bbca6ae0233 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1676 microversion: 2.1 time: 0.174723 Aug 29 19:08:41.146435 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 335/685] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:40 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:41.312933 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9cf90906-f615-4da3-b80e-21e711eda48a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:41.313537 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9cf90906-f615-4da3-b80e-21e711eda48a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:41.321342 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cf90906-f615-4da3-b80e-21e711eda48a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:41.322077 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cf90906-f615-4da3-b80e-21e711eda48a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:41.322712 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cf90906-f615-4da3-b80e-21e711eda48a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:41.323459 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cf90906-f615-4da3-b80e-21e711eda48a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:41.323908 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cf90906-f615-4da3-b80e-21e711eda48a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:41.324330 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cf90906-f615-4da3-b80e-21e711eda48a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:41.487471 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9cf90906-f615-4da3-b80e-21e711eda48a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:41.500508 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9cf90906-f615-4da3-b80e-21e711eda48a tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1715 microversion: 2.1 time: 0.190943 Aug 29 19:08:41.515090 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 351/686] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:41 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1715 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:41.643464 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bf657da7-9237-4c9a-986d-03b75d673514 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:41.643841 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bf657da7-9237-4c9a-986d-03b75d673514 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:41.650366 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bf657da7-9237-4c9a-986d-03b75d673514 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:41.650881 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bf657da7-9237-4c9a-986d-03b75d673514 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:41.651524 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bf657da7-9237-4c9a-986d-03b75d673514 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:41.652251 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bf657da7-9237-4c9a-986d-03b75d673514 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:41.652974 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bf657da7-9237-4c9a-986d-03b75d673514 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:41.653617 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bf657da7-9237-4c9a-986d-03b75d673514 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:41.832704 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-bf657da7-9237-4c9a-986d-03b75d673514 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] HTTP exception thrown: Cannot 'detach_volume' instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 while it is in vm_state rescued Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bf657da7-9237-4c9a-986d-03b75d673514 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Request method failure captured: Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: DELETE /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/os-volume_attachments/1284e0d2-8329-4967-8cdb-905198ae8ea1 HTTP/1.1 Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0iXUiYAovRqQ_az3rcpV1ErfEOG6trSM7yEPHZtNh_PNMrhUUN1DHoJV2O5dMcZRrxSKLkM3xKL5tZa-zkwcA48hyuHNQtm_bZy3itxXiOiqM8IYzpwkftFeh9qTl5oUhccTMyqLAPh4AYeWpt5neoT-NEmjsyd5fGZ_d_CGMaZrA Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 4f32b60f5fa8427386bafa1a91f4e608 Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-582562329 Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:08:41.836062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:08:41.838342 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4f32b60f5fa8427386bafa1a91f4e608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4f32b60f5fa8427386bafa1a91f4e608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/4f32b60f5fa8427386bafa1a91f4e608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_4f32b60f5fa8427386bafa1a91f4e608"}]}] Aug 29 19:08:41.838342 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-ServerRescueNegativeTestJSON-582562329 Aug 29 19:08:41.838342 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 4f32b60f5fa8427386bafa1a91f4e608 Aug 29 19:08:41.838342 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-582562329 Aug 29 19:08:41.838342 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-ServerRescueNegativeTestJSON-582562329-project Aug 29 19:08:41.838342 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:08:41.838342 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:08:41.838342 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: 962284e9a353430881bc119e5f80a890 Aug 29 19:08:41.838342 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-ServerRescueNegativeTestJSON-582562329-project Aug 29 19:08:41.838342 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:08:41.838342 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Cannot 'detach_volume' instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 while it is in vm_state rescued Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'server_id': '2fb25d6a-e6bb-4fb7-917c-07041d4509a3', 'id': '1284e0d2-8329-4967-8cdb-905198ae8ea1'} Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:08:41.839200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:08:41.840884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 19:08:41.840884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 19:08:41.840884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 19:08:41.840884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 19:08:41.840884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 while it is in vm_state rescued Aug 29 19:08:41.840884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:08:41.840884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:08:41.840884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:08:41.840884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:08:41.840884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:08:41.840884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:08:41.840884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:08:41.840884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:08:41.840884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 while it is in vm_state rescued Aug 29 19:08:41.840884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:08:41.840884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bf657da7-9237-4c9a-986d-03b75d673514 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Returning 409 to user: Cannot 'detach_volume' instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 while it is in vm_state rescued {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:08:41.849179 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bf657da7-9237-4c9a-986d-03b75d673514 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "DELETE /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/os-volume_attachments/1284e0d2-8329-4967-8cdb-905198ae8ea1" status: 409 len: 152 microversion: 2.1 time: 0.199692 Aug 29 19:08:41.849179 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 336/687] 10.222.0.86 () {58 vars in 1416 bytes} [Mon Aug 29 19:08:41 2022] DELETE /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/os-volume_attachments/1284e0d2-8329-4967-8cdb-905198ae8ea1 => generated 152 bytes in 201 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 19:08:41.849967 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b5398094-4ed8-470a-882d-15ed52080300 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:41.850523 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b5398094-4ed8-470a-882d-15ed52080300 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:41.857065 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5398094-4ed8-470a-882d-15ed52080300 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:41.857783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5398094-4ed8-470a-882d-15ed52080300 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:41.858245 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5398094-4ed8-470a-882d-15ed52080300 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:41.859233 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5398094-4ed8-470a-882d-15ed52080300 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:41.859547 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5398094-4ed8-470a-882d-15ed52080300 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:41.860382 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5398094-4ed8-470a-882d-15ed52080300 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:41.886839 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:41.949532 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b5398094-4ed8-470a-882d-15ed52080300 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "POST /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/action" status: 202 len: 0 microversion: 2.1 time: 0.105343 Aug 29 19:08:41.950351 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 352/688] 10.222.0.86 () {60 vars in 1278 bytes} [Mon Aug 29 19:08:41 2022] POST /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:08:41.958445 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-436c8208-d187-459d-a6c5-5d68302bc6db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:41.959745 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-436c8208-d187-459d-a6c5-5d68302bc6db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:41.966750 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-436c8208-d187-459d-a6c5-5d68302bc6db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:41.967420 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-436c8208-d187-459d-a6c5-5d68302bc6db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:41.967863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-436c8208-d187-459d-a6c5-5d68302bc6db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:41.968566 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-436c8208-d187-459d-a6c5-5d68302bc6db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:41.969022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-436c8208-d187-459d-a6c5-5d68302bc6db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:41.969463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-436c8208-d187-459d-a6c5-5d68302bc6db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:42.137134 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-436c8208-d187-459d-a6c5-5d68302bc6db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:42.152285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-436c8208-d187-459d-a6c5-5d68302bc6db tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1723 microversion: 2.1 time: 0.196990 Aug 29 19:08:42.153257 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 337/689] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:41 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:42.177690 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-399ea294-4e17-4bc2-96fc-9f5cb8650117 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:42.178758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-399ea294-4e17-4bc2-96fc-9f5cb8650117 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:42.187938 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-399ea294-4e17-4bc2-96fc-9f5cb8650117 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:42.188755 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-399ea294-4e17-4bc2-96fc-9f5cb8650117 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:42.189254 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-399ea294-4e17-4bc2-96fc-9f5cb8650117 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:42.190227 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-399ea294-4e17-4bc2-96fc-9f5cb8650117 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:42.190843 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-399ea294-4e17-4bc2-96fc-9f5cb8650117 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:42.191430 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-399ea294-4e17-4bc2-96fc-9f5cb8650117 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:42.370527 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-399ea294-4e17-4bc2-96fc-9f5cb8650117 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:42.383022 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-399ea294-4e17-4bc2-96fc-9f5cb8650117 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1676 microversion: 2.1 time: 0.218294 Aug 29 19:08:42.384351 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 353/690] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:42 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1676 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:43.178720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-36593238-a7eb-427a-9464-94813a6ffb82 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:43.179360 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-36593238-a7eb-427a-9464-94813a6ffb82 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:43.186485 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36593238-a7eb-427a-9464-94813a6ffb82 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:43.186977 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36593238-a7eb-427a-9464-94813a6ffb82 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:43.187446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36593238-a7eb-427a-9464-94813a6ffb82 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:43.188139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36593238-a7eb-427a-9464-94813a6ffb82 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:43.188585 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36593238-a7eb-427a-9464-94813a6ffb82 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:43.189011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36593238-a7eb-427a-9464-94813a6ffb82 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:43.330384 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-36593238-a7eb-427a-9464-94813a6ffb82 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:43.338694 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-36593238-a7eb-427a-9464-94813a6ffb82 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1723 microversion: 2.1 time: 0.163927 Aug 29 19:08:43.339272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 338/691] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:43 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:43.404307 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-06ca9db0-e2b4-4f59-909c-51c7d917a91b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:43.404937 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-06ca9db0-e2b4-4f59-909c-51c7d917a91b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:43.411431 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06ca9db0-e2b4-4f59-909c-51c7d917a91b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:43.411919 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06ca9db0-e2b4-4f59-909c-51c7d917a91b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:43.412356 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06ca9db0-e2b4-4f59-909c-51c7d917a91b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:43.413047 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06ca9db0-e2b4-4f59-909c-51c7d917a91b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:43.413502 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06ca9db0-e2b4-4f59-909c-51c7d917a91b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:43.413929 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06ca9db0-e2b4-4f59-909c-51c7d917a91b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:43.545999 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-06ca9db0-e2b4-4f59-909c-51c7d917a91b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:43.554170 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-06ca9db0-e2b4-4f59-909c-51c7d917a91b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1676 microversion: 2.1 time: 0.153630 Aug 29 19:08:43.554753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 354/692] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:43 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:44.360519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4514c999-2f34-4104-a557-78e367004fbf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:44.361129 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4514c999-2f34-4104-a557-78e367004fbf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:44.368847 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4514c999-2f34-4104-a557-78e367004fbf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:44.369353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4514c999-2f34-4104-a557-78e367004fbf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:44.369795 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4514c999-2f34-4104-a557-78e367004fbf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:44.370513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4514c999-2f34-4104-a557-78e367004fbf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:44.370967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4514c999-2f34-4104-a557-78e367004fbf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:44.371414 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4514c999-2f34-4104-a557-78e367004fbf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:44.503640 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4514c999-2f34-4104-a557-78e367004fbf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:44.512743 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4514c999-2f34-4104-a557-78e367004fbf tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1723 microversion: 2.1 time: 0.156088 Aug 29 19:08:44.513310 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 339/693] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:44 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:44.576791 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cddaaabb-db1c-4de4-bbc6-7c9ceedc4ead tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:44.577461 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cddaaabb-db1c-4de4-bbc6-7c9ceedc4ead tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:44.584217 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cddaaabb-db1c-4de4-bbc6-7c9ceedc4ead tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:44.584700 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cddaaabb-db1c-4de4-bbc6-7c9ceedc4ead tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:44.585131 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cddaaabb-db1c-4de4-bbc6-7c9ceedc4ead tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:44.585825 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cddaaabb-db1c-4de4-bbc6-7c9ceedc4ead tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:44.586272 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cddaaabb-db1c-4de4-bbc6-7c9ceedc4ead tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:44.587229 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cddaaabb-db1c-4de4-bbc6-7c9ceedc4ead tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:44.720540 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cddaaabb-db1c-4de4-bbc6-7c9ceedc4ead tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:44.729166 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cddaaabb-db1c-4de4-bbc6-7c9ceedc4ead tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1676 microversion: 2.1 time: 0.156716 Aug 29 19:08:44.729725 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 355/694] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:44 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:45.534712 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cca0f9ce-6414-490c-97aa-c5df2d30cdad tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:45.535301 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-cca0f9ce-6414-490c-97aa-c5df2d30cdad tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:45.541802 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cca0f9ce-6414-490c-97aa-c5df2d30cdad tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:45.542285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cca0f9ce-6414-490c-97aa-c5df2d30cdad tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:45.542717 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cca0f9ce-6414-490c-97aa-c5df2d30cdad tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:45.543441 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cca0f9ce-6414-490c-97aa-c5df2d30cdad tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:45.543897 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cca0f9ce-6414-490c-97aa-c5df2d30cdad tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:45.544321 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cca0f9ce-6414-490c-97aa-c5df2d30cdad tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:45.562404 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:45.681906 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-cca0f9ce-6414-490c-97aa-c5df2d30cdad tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:45.691188 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-cca0f9ce-6414-490c-97aa-c5df2d30cdad tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1723 microversion: 2.1 time: 0.160725 Aug 29 19:08:45.691813 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 340/695] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:45 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:45.749689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2ca46544-70bd-482b-9658-3783afb3724e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:45.750299 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2ca46544-70bd-482b-9658-3783afb3724e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:45.756890 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ca46544-70bd-482b-9658-3783afb3724e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:45.757605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ca46544-70bd-482b-9658-3783afb3724e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:45.758214 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ca46544-70bd-482b-9658-3783afb3724e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:45.759182 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ca46544-70bd-482b-9658-3783afb3724e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:45.759772 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ca46544-70bd-482b-9658-3783afb3724e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:45.760331 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ca46544-70bd-482b-9658-3783afb3724e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:45.899901 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2ca46544-70bd-482b-9658-3783afb3724e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:45.907625 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2ca46544-70bd-482b-9658-3783afb3724e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1676 microversion: 2.1 time: 0.161797 Aug 29 19:08:45.908188 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 356/696] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:45 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:46.714880 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c86c80d9-0a14-4ff3-af3e-4b86f58fcf13 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:46.715545 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c86c80d9-0a14-4ff3-af3e-4b86f58fcf13 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:46.722133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c86c80d9-0a14-4ff3-af3e-4b86f58fcf13 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:46.722640 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c86c80d9-0a14-4ff3-af3e-4b86f58fcf13 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:46.723101 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c86c80d9-0a14-4ff3-af3e-4b86f58fcf13 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:46.723798 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c86c80d9-0a14-4ff3-af3e-4b86f58fcf13 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:46.724248 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c86c80d9-0a14-4ff3-af3e-4b86f58fcf13 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:46.724672 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c86c80d9-0a14-4ff3-af3e-4b86f58fcf13 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:46.859236 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c86c80d9-0a14-4ff3-af3e-4b86f58fcf13 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:46.867925 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c86c80d9-0a14-4ff3-af3e-4b86f58fcf13 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1729 microversion: 2.1 time: 0.158237 Aug 29 19:08:46.868504 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 341/697] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:46 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:46.889736 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5960ce88-76e1-4a7f-ae1c-d57d947c0790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:46.890282 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5960ce88-76e1-4a7f-ae1c-d57d947c0790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:46.896786 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5960ce88-76e1-4a7f-ae1c-d57d947c0790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:46.897262 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5960ce88-76e1-4a7f-ae1c-d57d947c0790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:46.897693 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5960ce88-76e1-4a7f-ae1c-d57d947c0790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:46.898366 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5960ce88-76e1-4a7f-ae1c-d57d947c0790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:46.898816 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5960ce88-76e1-4a7f-ae1c-d57d947c0790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:46.900001 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5960ce88-76e1-4a7f-ae1c-d57d947c0790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:46.929716 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-dbe4d4c2-7b58-459a-9ed5-16297c8fd51d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:46.930479 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-dbe4d4c2-7b58-459a-9ed5-16297c8fd51d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:46.936583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dbe4d4c2-7b58-459a-9ed5-16297c8fd51d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:46.937168 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dbe4d4c2-7b58-459a-9ed5-16297c8fd51d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:46.937704 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dbe4d4c2-7b58-459a-9ed5-16297c8fd51d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:46.938522 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dbe4d4c2-7b58-459a-9ed5-16297c8fd51d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:46.939019 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dbe4d4c2-7b58-459a-9ed5-16297c8fd51d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:46.939466 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dbe4d4c2-7b58-459a-9ed5-16297c8fd51d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:46.976398 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5960ce88-76e1-4a7f-ae1c-d57d947c0790 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090492 Aug 29 19:08:46.976986 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 357/698] 10.222.0.86 () {58 vars in 1275 bytes} [Mon Aug 29 19:08:46 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:47.077733 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-dbe4d4c2-7b58-459a-9ed5-16297c8fd51d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:47.085536 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-dbe4d4c2-7b58-459a-9ed5-16297c8fd51d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1653 microversion: 2.1 time: 0.159701 Aug 29 19:08:47.086136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 342/699] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:46 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1653 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:47.107724 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-30e679f0-8576-49bf-971e-7b5627808db3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:47.113745 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30e679f0-8576-49bf-971e-7b5627808db3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:47.114498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30e679f0-8576-49bf-971e-7b5627808db3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:47.114926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30e679f0-8576-49bf-971e-7b5627808db3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:47.139807 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-30e679f0-8576-49bf-971e-7b5627808db3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Going to try to start instance {{(pid=120707) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 19:08:47.185034 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-30e679f0-8576-49bf-971e-7b5627808db3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "POST /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/action" status: 202 len: 0 microversion: 2.1 time: 0.081438 Aug 29 19:08:47.185655 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 358/700] 10.222.0.86 () {60 vars in 1278 bytes} [Mon Aug 29 19:08:47 2022] POST /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:08:47.194136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d3551684-015d-4b1b-aea3-658ab955e71f tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:47.194732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d3551684-015d-4b1b-aea3-658ab955e71f tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:47.201609 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3551684-015d-4b1b-aea3-658ab955e71f tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:47.202109 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3551684-015d-4b1b-aea3-658ab955e71f tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:47.202688 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3551684-015d-4b1b-aea3-658ab955e71f tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:47.203482 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3551684-015d-4b1b-aea3-658ab955e71f tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:47.203938 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3551684-015d-4b1b-aea3-658ab955e71f tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:47.204514 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3551684-015d-4b1b-aea3-658ab955e71f tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:47.354513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d3551684-015d-4b1b-aea3-658ab955e71f tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:47.363355 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d3551684-015d-4b1b-aea3-658ab955e71f tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1662 microversion: 2.1 time: 0.173372 Aug 29 19:08:47.364186 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 343/701] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:47 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1662 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:48.293034 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-a8496dc5-4d94-48f7-a1cf-cacf9ecc3b0e req-536c6fef-7e90-4373-983d-897485e6e792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb25d6a-e6bb-4fb7-917c-07041d4509a3", "tag": "769a3c22-a257-4a0e-ab9e-27222b92bfb1"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:48.310688 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=41 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:48.313949 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a8496dc5-4d94-48f7-a1cf-cacf9ecc3b0e req-536c6fef-7e90-4373-983d-897485e6e792 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:48.314566 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a8496dc5-4d94-48f7-a1cf-cacf9ecc3b0e req-536c6fef-7e90-4373-983d-897485e6e792 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:48.315131 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a8496dc5-4d94-48f7-a1cf-cacf9ecc3b0e req-536c6fef-7e90-4373-983d-897485e6e792 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:48.333035 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-a8496dc5-4d94-48f7-a1cf-cacf9ecc3b0e req-536c6fef-7e90-4373-983d-897485e6e792 service nova] Creating event network-changed:769a3c22-a257-4a0e-ab9e-27222b92bfb1 for instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 on hv-cinder-85083 Aug 29 19:08:48.338091 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-a8496dc5-4d94-48f7-a1cf-cacf9ecc3b0e req-536c6fef-7e90-4373-983d-897485e6e792 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050404 Aug 29 19:08:48.338785 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 359/702] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:48.384304 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-223ce950-43be-453a-89c9-37301dbf139a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:48.385024 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-223ce950-43be-453a-89c9-37301dbf139a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:48.391718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-223ce950-43be-453a-89c9-37301dbf139a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:48.392215 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-223ce950-43be-453a-89c9-37301dbf139a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:48.392651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-223ce950-43be-453a-89c9-37301dbf139a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:48.393368 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-223ce950-43be-453a-89c9-37301dbf139a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:48.393852 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-223ce950-43be-453a-89c9-37301dbf139a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:48.394276 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-223ce950-43be-453a-89c9-37301dbf139a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:48.546507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-223ce950-43be-453a-89c9-37301dbf139a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:48.554189 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-223ce950-43be-453a-89c9-37301dbf139a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1662 microversion: 2.1 time: 0.173999 Aug 29 19:08:48.554771 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 344/703] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:48 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1662 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:49.577704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-331445bc-f512-40f4-ad8a-8d1f9a7dc9c8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:49.578299 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-331445bc-f512-40f4-ad8a-8d1f9a7dc9c8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:49.584552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-331445bc-f512-40f4-ad8a-8d1f9a7dc9c8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:49.585031 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-331445bc-f512-40f4-ad8a-8d1f9a7dc9c8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:49.585458 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-331445bc-f512-40f4-ad8a-8d1f9a7dc9c8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:49.586135 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-331445bc-f512-40f4-ad8a-8d1f9a7dc9c8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:49.587099 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-331445bc-f512-40f4-ad8a-8d1f9a7dc9c8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:49.587540 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-331445bc-f512-40f4-ad8a-8d1f9a7dc9c8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:49.729435 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-331445bc-f512-40f4-ad8a-8d1f9a7dc9c8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:49.737260 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-331445bc-f512-40f4-ad8a-8d1f9a7dc9c8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1662 microversion: 2.1 time: 0.164335 Aug 29 19:08:49.737826 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 360/704] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:49 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1662 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:50.352401 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-ca5269f0-9b95-41bc-aeb4-3597b6c7dd29 req-7e1ce8cc-2822-47bb-8301-b742a691b443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb25d6a-e6bb-4fb7-917c-07041d4509a3", "tag": "769a3c22-a257-4a0e-ab9e-27222b92bfb1"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:50.357616 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=4 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:50.363628 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ca5269f0-9b95-41bc-aeb4-3597b6c7dd29 req-7e1ce8cc-2822-47bb-8301-b742a691b443 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:50.364099 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ca5269f0-9b95-41bc-aeb4-3597b6c7dd29 req-7e1ce8cc-2822-47bb-8301-b742a691b443 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:50.364524 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ca5269f0-9b95-41bc-aeb4-3597b6c7dd29 req-7e1ce8cc-2822-47bb-8301-b742a691b443 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:50.375296 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-ca5269f0-9b95-41bc-aeb4-3597b6c7dd29 req-7e1ce8cc-2822-47bb-8301-b742a691b443 service nova] Creating event network-changed:769a3c22-a257-4a0e-ab9e-27222b92bfb1 for instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 on hv-cinder-85083 Aug 29 19:08:50.380299 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-ca5269f0-9b95-41bc-aeb4-3597b6c7dd29 req-7e1ce8cc-2822-47bb-8301-b742a691b443 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031563 Aug 29 19:08:50.381017 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 345/705] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:50.757866 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5cfac672-f74f-4151-9e07-3394c6a393ed tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:50.759020 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5cfac672-f74f-4151-9e07-3394c6a393ed tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:50.765930 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5cfac672-f74f-4151-9e07-3394c6a393ed tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:50.766418 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5cfac672-f74f-4151-9e07-3394c6a393ed tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:50.766853 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5cfac672-f74f-4151-9e07-3394c6a393ed tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:50.767572 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5cfac672-f74f-4151-9e07-3394c6a393ed tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:50.768025 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5cfac672-f74f-4151-9e07-3394c6a393ed tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:50.768445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5cfac672-f74f-4151-9e07-3394c6a393ed tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:50.902157 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5cfac672-f74f-4151-9e07-3394c6a393ed tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:50.910074 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5cfac672-f74f-4151-9e07-3394c6a393ed tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1666 microversion: 2.1 time: 0.156078 Aug 29 19:08:50.910802 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 361/706] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:50 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:04.847586 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:04.848420 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=28 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:04.853861 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-15491536", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-950876423", "security_groups": [{"name": "tempest-secgroup-smoke-1075310592"}], "block_device_mapping_v2": [{"uuid": "205f8f64-875b-4062-9f52-101d6b62f662", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "230bc59f-c520-4141-9d7a-a6fcb67f0194"}]}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:04.966925 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] validate_networks() for [('230bc59f-c520-4141-9d7a-a6fcb67f0194', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:09:05.335213 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:09:05.335635 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:09:05.336613 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:09:05.337014 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:09:05.337423 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:09:05.346143 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:05.346646 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:05.347098 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:05.347816 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:05.348262 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:05.348677 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:05.365956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Getting quotas for project 5d70fdff5c5a443b9f0ae1a24dfffcd3. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:09:05.370029 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Getting quotas for user 0547f15d00f043b99de10f3db7348c62 and project 5d70fdff5c5a443b9f0ae1a24dfffcd3. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:09:05.426156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:09:05.428377 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='205f8f64-875b-4062-9f52-101d6b62f662',volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:09:05.556571 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2bbe1df0-ac5e-4b8a-b30d-1851b35761e2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.710849 Aug 29 19:09:05.557414 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 346/707] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:09:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:09:05.567961 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-549ef919-40c2-4650-b961-3858279e3312 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:05.568569 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-549ef919-40c2-4650-b961-3858279e3312 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:05.570774 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=5 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:05.572077 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:05.626009 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-549ef919-40c2-4650-b961-3858279e3312 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:05.634261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-549ef919-40c2-4650-b961-3858279e3312 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1092 microversion: 2.1 time: 0.070214 Aug 29 19:09:05.634829 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 362/708] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:05 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1092 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:06.656134 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c1f241fe-fca7-49cf-b8f6-8020f9ab3a65 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:06.656692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c1f241fe-fca7-49cf-b8f6-8020f9ab3a65 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:06.663582 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1f241fe-fca7-49cf-b8f6-8020f9ab3a65 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:06.664118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1f241fe-fca7-49cf-b8f6-8020f9ab3a65 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:06.664580 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1f241fe-fca7-49cf-b8f6-8020f9ab3a65 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:06.665278 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1f241fe-fca7-49cf-b8f6-8020f9ab3a65 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:06.665792 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1f241fe-fca7-49cf-b8f6-8020f9ab3a65 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:06.666203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1f241fe-fca7-49cf-b8f6-8020f9ab3a65 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:06.729110 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c1f241fe-fca7-49cf-b8f6-8020f9ab3a65 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:06.736867 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c1f241fe-fca7-49cf-b8f6-8020f9ab3a65 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1190 microversion: 2.1 time: 0.085256 Aug 29 19:09:06.737454 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 347/709] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:06 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1190 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:07.762495 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2975f315-c51b-4976-abf1-cf20d91158d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:07.763149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2975f315-c51b-4976-abf1-cf20d91158d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:07.770318 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2975f315-c51b-4976-abf1-cf20d91158d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:07.770811 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2975f315-c51b-4976-abf1-cf20d91158d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:07.771278 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2975f315-c51b-4976-abf1-cf20d91158d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:07.771987 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2975f315-c51b-4976-abf1-cf20d91158d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:07.772445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2975f315-c51b-4976-abf1-cf20d91158d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:07.772866 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2975f315-c51b-4976-abf1-cf20d91158d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:07.936383 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2975f315-c51b-4976-abf1-cf20d91158d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:07.946657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2975f315-c51b-4976-abf1-cf20d91158d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1276 microversion: 2.1 time: 0.188011 Aug 29 19:09:07.948052 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 363/710] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:07 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:08.379099 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-7bbb672b-994d-4b23-b40b-484a662948fc req-8d0f12df-ceac-4280-b69c-10b13a3b4b14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee5a9c09-ea98-4feb-bbe7-f942b9ef1672", "tag": "c815ca56-6391-4ced-92fa-9e28f650e18d"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:08.389233 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-7bbb672b-994d-4b23-b40b-484a662948fc req-8d0f12df-ceac-4280-b69c-10b13a3b4b14 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:08.389844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-7bbb672b-994d-4b23-b40b-484a662948fc req-8d0f12df-ceac-4280-b69c-10b13a3b4b14 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:08.390401 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-7bbb672b-994d-4b23-b40b-484a662948fc req-8d0f12df-ceac-4280-b69c-10b13a3b4b14 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:08.402257 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-7bbb672b-994d-4b23-b40b-484a662948fc req-8d0f12df-ceac-4280-b69c-10b13a3b4b14 service nova] Creating event network-changed:c815ca56-6391-4ced-92fa-9e28f650e18d for instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 on hv-cinder-85083 Aug 29 19:09:08.407233 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-7bbb672b-994d-4b23-b40b-484a662948fc req-8d0f12df-ceac-4280-b69c-10b13a3b4b14 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032024 Aug 29 19:09:08.407972 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 348/711] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:08.968680 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6943079a-53ab-4c2d-8428-f39fd86a04a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:08.969226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6943079a-53ab-4c2d-8428-f39fd86a04a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:08.975703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6943079a-53ab-4c2d-8428-f39fd86a04a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:08.976186 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6943079a-53ab-4c2d-8428-f39fd86a04a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:08.977224 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6943079a-53ab-4c2d-8428-f39fd86a04a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:08.977921 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6943079a-53ab-4c2d-8428-f39fd86a04a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:08.978378 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6943079a-53ab-4c2d-8428-f39fd86a04a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:08.978797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6943079a-53ab-4c2d-8428-f39fd86a04a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:09.106030 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6943079a-53ab-4c2d-8428-f39fd86a04a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:09.113557 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6943079a-53ab-4c2d-8428-f39fd86a04a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1264 microversion: 2.1 time: 0.148893 Aug 29 19:09:09.114107 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 364/712] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:08 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:10.136305 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1426b8bb-e101-42d3-9681-c00df2d7f463 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:10.136993 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1426b8bb-e101-42d3-9681-c00df2d7f463 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:10.143303 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1426b8bb-e101-42d3-9681-c00df2d7f463 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:10.143792 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1426b8bb-e101-42d3-9681-c00df2d7f463 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:10.144228 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1426b8bb-e101-42d3-9681-c00df2d7f463 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:10.144927 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1426b8bb-e101-42d3-9681-c00df2d7f463 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:10.145381 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1426b8bb-e101-42d3-9681-c00df2d7f463 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:10.145802 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1426b8bb-e101-42d3-9681-c00df2d7f463 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:10.282159 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1426b8bb-e101-42d3-9681-c00df2d7f463 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:10.290690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1426b8bb-e101-42d3-9681-c00df2d7f463 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1264 microversion: 2.1 time: 0.159991 Aug 29 19:09:10.291315 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 349/713] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:10 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:11.311691 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-84a5720e-8c27-47e7-b12c-e3add1995f94 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:11.312290 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-84a5720e-8c27-47e7-b12c-e3add1995f94 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:11.318716 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-84a5720e-8c27-47e7-b12c-e3add1995f94 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:11.319245 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-84a5720e-8c27-47e7-b12c-e3add1995f94 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:11.319682 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-84a5720e-8c27-47e7-b12c-e3add1995f94 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:11.320418 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-84a5720e-8c27-47e7-b12c-e3add1995f94 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:11.320873 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-84a5720e-8c27-47e7-b12c-e3add1995f94 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:11.321300 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-84a5720e-8c27-47e7-b12c-e3add1995f94 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:11.452613 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-84a5720e-8c27-47e7-b12c-e3add1995f94 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:11.460271 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-84a5720e-8c27-47e7-b12c-e3add1995f94 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1264 microversion: 2.1 time: 0.152469 Aug 29 19:09:11.460836 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 365/714] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:11 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:12.481585 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-55b9b18c-5eff-43f3-bb04-6293c61ea919 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:12.482219 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-55b9b18c-5eff-43f3-bb04-6293c61ea919 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:12.488590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55b9b18c-5eff-43f3-bb04-6293c61ea919 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:12.489072 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55b9b18c-5eff-43f3-bb04-6293c61ea919 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:12.489506 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55b9b18c-5eff-43f3-bb04-6293c61ea919 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:12.490190 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55b9b18c-5eff-43f3-bb04-6293c61ea919 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:12.490641 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55b9b18c-5eff-43f3-bb04-6293c61ea919 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:12.491087 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55b9b18c-5eff-43f3-bb04-6293c61ea919 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:12.619683 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-55b9b18c-5eff-43f3-bb04-6293c61ea919 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:12.627229 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-55b9b18c-5eff-43f3-bb04-6293c61ea919 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1264 microversion: 2.1 time: 0.149561 Aug 29 19:09:12.627782 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 350/715] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:12 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:13.647801 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-10d69158-7f20-4509-9024-05082c4e263d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:13.648412 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-10d69158-7f20-4509-9024-05082c4e263d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:13.654862 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-10d69158-7f20-4509-9024-05082c4e263d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:13.655376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-10d69158-7f20-4509-9024-05082c4e263d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:13.655810 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-10d69158-7f20-4509-9024-05082c4e263d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:13.656496 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-10d69158-7f20-4509-9024-05082c4e263d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:13.656955 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-10d69158-7f20-4509-9024-05082c4e263d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:13.657608 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-10d69158-7f20-4509-9024-05082c4e263d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:13.794442 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-10d69158-7f20-4509-9024-05082c4e263d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:13.801901 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-10d69158-7f20-4509-9024-05082c4e263d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1264 microversion: 2.1 time: 0.158103 Aug 29 19:09:13.802456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 366/716] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:13 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:14.823634 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-19ed69fe-601e-4d6c-95d2-f27100e3600c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:14.824244 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-19ed69fe-601e-4d6c-95d2-f27100e3600c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:14.830814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19ed69fe-601e-4d6c-95d2-f27100e3600c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:14.831332 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19ed69fe-601e-4d6c-95d2-f27100e3600c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:14.831766 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19ed69fe-601e-4d6c-95d2-f27100e3600c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:14.832448 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19ed69fe-601e-4d6c-95d2-f27100e3600c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:14.832900 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19ed69fe-601e-4d6c-95d2-f27100e3600c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:14.833320 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19ed69fe-601e-4d6c-95d2-f27100e3600c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:14.962126 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-19ed69fe-601e-4d6c-95d2-f27100e3600c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:14.970077 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-19ed69fe-601e-4d6c-95d2-f27100e3600c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1264 microversion: 2.1 time: 0.151052 Aug 29 19:09:14.970638 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 351/717] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:14 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:15.990537 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7bbf6753-7912-4a7c-b8a7-b2ff2028a082 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:15.991194 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7bbf6753-7912-4a7c-b8a7-b2ff2028a082 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:15.994051 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:15.999529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7bbf6753-7912-4a7c-b8a7-b2ff2028a082 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:16.000016 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7bbf6753-7912-4a7c-b8a7-b2ff2028a082 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:16.000448 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7bbf6753-7912-4a7c-b8a7-b2ff2028a082 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:16.001134 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7bbf6753-7912-4a7c-b8a7-b2ff2028a082 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:16.001586 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7bbf6753-7912-4a7c-b8a7-b2ff2028a082 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:16.002010 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7bbf6753-7912-4a7c-b8a7-b2ff2028a082 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:16.141243 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7bbf6753-7912-4a7c-b8a7-b2ff2028a082 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:16.148909 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7bbf6753-7912-4a7c-b8a7-b2ff2028a082 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1264 microversion: 2.1 time: 0.162551 Aug 29 19:09:16.149471 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 367/718] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:15 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:17.169907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1a810fb1-188c-404e-a35c-5cc1a2eb167d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:17.170514 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1a810fb1-188c-404e-a35c-5cc1a2eb167d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:17.172481 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:17.173224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:17.181200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a810fb1-188c-404e-a35c-5cc1a2eb167d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:17.181686 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a810fb1-188c-404e-a35c-5cc1a2eb167d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:17.182113 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a810fb1-188c-404e-a35c-5cc1a2eb167d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:17.182803 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a810fb1-188c-404e-a35c-5cc1a2eb167d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:17.183273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a810fb1-188c-404e-a35c-5cc1a2eb167d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:17.183693 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a810fb1-188c-404e-a35c-5cc1a2eb167d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:17.318714 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1a810fb1-188c-404e-a35c-5cc1a2eb167d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:17.327170 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1a810fb1-188c-404e-a35c-5cc1a2eb167d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1264 microversion: 2.1 time: 0.160908 Aug 29 19:09:17.327927 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 352/719] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:17 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:18.348786 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a32a7804-c69a-4bb1-9ab0-948aff3bc597 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:18.349397 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a32a7804-c69a-4bb1-9ab0-948aff3bc597 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:18.356408 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a32a7804-c69a-4bb1-9ab0-948aff3bc597 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:18.356889 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a32a7804-c69a-4bb1-9ab0-948aff3bc597 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:18.357333 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a32a7804-c69a-4bb1-9ab0-948aff3bc597 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:18.358013 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a32a7804-c69a-4bb1-9ab0-948aff3bc597 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:18.358463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a32a7804-c69a-4bb1-9ab0-948aff3bc597 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:18.358886 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a32a7804-c69a-4bb1-9ab0-948aff3bc597 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:18.491146 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a32a7804-c69a-4bb1-9ab0-948aff3bc597 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:18.498732 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a32a7804-c69a-4bb1-9ab0-948aff3bc597 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1264 microversion: 2.1 time: 0.153888 Aug 29 19:09:18.499323 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 368/720] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:18 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:19.255304 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-0b9fe81a-dd2b-424b-b4c2-6391ee109130 req-2bf3b55a-6a9a-441c-9568-2b71b95b9e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee5a9c09-ea98-4feb-bbe7-f942b9ef1672", "name": "network-vif-plugged", "status": "completed", "tag": "c815ca56-6391-4ced-92fa-9e28f650e18d"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:19.266008 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-0b9fe81a-dd2b-424b-b4c2-6391ee109130 req-2bf3b55a-6a9a-441c-9568-2b71b95b9e62 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:19.266607 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-0b9fe81a-dd2b-424b-b4c2-6391ee109130 req-2bf3b55a-6a9a-441c-9568-2b71b95b9e62 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:19.267200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-0b9fe81a-dd2b-424b-b4c2-6391ee109130 req-2bf3b55a-6a9a-441c-9568-2b71b95b9e62 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:19.278918 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-0b9fe81a-dd2b-424b-b4c2-6391ee109130 req-2bf3b55a-6a9a-441c-9568-2b71b95b9e62 service nova] Creating event network-vif-plugged:c815ca56-6391-4ced-92fa-9e28f650e18d for instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 on hv-cinder-85083 Aug 29 19:09:19.283863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-0b9fe81a-dd2b-424b-b4c2-6391ee109130 req-2bf3b55a-6a9a-441c-9568-2b71b95b9e62 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032214 Aug 29 19:09:19.284680 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 353/721] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:19.519714 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-59e75e04-8d80-4a75-8193-8425b55244fa tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:19.520354 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-59e75e04-8d80-4a75-8193-8425b55244fa tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:19.526565 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59e75e04-8d80-4a75-8193-8425b55244fa tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:19.527088 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59e75e04-8d80-4a75-8193-8425b55244fa tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:19.527530 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59e75e04-8d80-4a75-8193-8425b55244fa tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:19.528236 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59e75e04-8d80-4a75-8193-8425b55244fa tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:19.528706 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59e75e04-8d80-4a75-8193-8425b55244fa tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:19.529125 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59e75e04-8d80-4a75-8193-8425b55244fa tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:19.663461 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-59e75e04-8d80-4a75-8193-8425b55244fa tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:19.670982 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-59e75e04-8d80-4a75-8193-8425b55244fa tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1264 microversion: 2.1 time: 0.155221 Aug 29 19:09:19.671572 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 369/722] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:19 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:20.693036 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6c12b3af-765b-4a2d-b21b-3bad37d7d729 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:20.693730 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6c12b3af-765b-4a2d-b21b-3bad37d7d729 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:20.700624 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6c12b3af-765b-4a2d-b21b-3bad37d7d729 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:20.701102 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6c12b3af-765b-4a2d-b21b-3bad37d7d729 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:20.701530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6c12b3af-765b-4a2d-b21b-3bad37d7d729 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:20.702212 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6c12b3af-765b-4a2d-b21b-3bad37d7d729 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:20.702668 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6c12b3af-765b-4a2d-b21b-3bad37d7d729 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:20.703119 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6c12b3af-765b-4a2d-b21b-3bad37d7d729 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:20.763273 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6adf4d88-e5bb-4be1-ac37-4de2ab929bd6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:20.763845 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6adf4d88-e5bb-4be1-ac37-4de2ab929bd6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:20.770531 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6adf4d88-e5bb-4be1-ac37-4de2ab929bd6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:20.771057 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6adf4d88-e5bb-4be1-ac37-4de2ab929bd6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:20.771501 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6adf4d88-e5bb-4be1-ac37-4de2ab929bd6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:20.772195 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6adf4d88-e5bb-4be1-ac37-4de2ab929bd6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:20.772651 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6adf4d88-e5bb-4be1-ac37-4de2ab929bd6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:20.773078 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6adf4d88-e5bb-4be1-ac37-4de2ab929bd6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:20.805159 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6adf4d88-e5bb-4be1-ac37-4de2ab929bd6 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/os-volume_attachments/98d1d819-ff35-40b6-bd82-e154750f24d5" status: 200 len: 194 microversion: 2.20 time: 0.046181 Aug 29 19:09:20.805937 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 370/723] 10.222.0.86 () {60 vars in 1454 bytes} [Mon Aug 29 19:09:20 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/os-volume_attachments/98d1d819-ff35-40b6-bd82-e154750f24d5 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:09:20.834575 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6c12b3af-765b-4a2d-b21b-3bad37d7d729 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:20.843120 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6c12b3af-765b-4a2d-b21b-3bad37d7d729 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1264 microversion: 2.1 time: 0.154952 Aug 29 19:09:20.843768 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 354/724] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:20 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:20.872739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d4eeb194-3413-4a5f-9233-fdb51d6e9141 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:20.873228 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d4eeb194-3413-4a5f-9233-fdb51d6e9141 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:20.879086 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4eeb194-3413-4a5f-9233-fdb51d6e9141 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:20.879567 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4eeb194-3413-4a5f-9233-fdb51d6e9141 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:20.879993 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4eeb194-3413-4a5f-9233-fdb51d6e9141 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:20.880816 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4eeb194-3413-4a5f-9233-fdb51d6e9141 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:20.881264 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4eeb194-3413-4a5f-9233-fdb51d6e9141 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:20.881681 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4eeb194-3413-4a5f-9233-fdb51d6e9141 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:20.961714 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-d4eeb194-3413-4a5f-9233-fdb51d6e9141 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lazy-loading 'services' on Instance uuid 55705ba3-2981-43e1-80e0-29995ee472a9 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:09:21.031577 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d4eeb194-3413-4a5f-9233-fdb51d6e9141 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "DELETE /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/os-volume_attachments/98d1d819-ff35-40b6-bd82-e154750f24d5" status: 202 len: 0 microversion: 2.20 time: 0.162614 Aug 29 19:09:21.032269 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 371/725] 10.222.0.86 () {60 vars in 1457 bytes} [Mon Aug 29 19:09:20 2022] DELETE /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/os-volume_attachments/98d1d819-ff35-40b6-bd82-e154750f24d5 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:09:21.040808 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7ea48a91-5a67-4389-bd8e-f803cba42bc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:21.043012 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7ea48a91-5a67-4389-bd8e-f803cba42bc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:21.049448 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ea48a91-5a67-4389-bd8e-f803cba42bc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:21.049935 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ea48a91-5a67-4389-bd8e-f803cba42bc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:21.050379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ea48a91-5a67-4389-bd8e-f803cba42bc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:21.051170 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ea48a91-5a67-4389-bd8e-f803cba42bc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:21.051611 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ea48a91-5a67-4389-bd8e-f803cba42bc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:21.052028 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ea48a91-5a67-4389-bd8e-f803cba42bc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:21.082616 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7ea48a91-5a67-4389-bd8e-f803cba42bc8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045692 Aug 29 19:09:21.083186 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 355/726] 10.222.0.86 () {60 vars in 1343 bytes} [Mon Aug 29 19:09:21 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 19:09:21.864901 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-69091252-14e1-4814-bdb4-f9c45f9dda29 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:21.865476 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-69091252-14e1-4814-bdb4-f9c45f9dda29 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:21.872110 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69091252-14e1-4814-bdb4-f9c45f9dda29 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:21.872608 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69091252-14e1-4814-bdb4-f9c45f9dda29 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:21.873035 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69091252-14e1-4814-bdb4-f9c45f9dda29 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:21.873709 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69091252-14e1-4814-bdb4-f9c45f9dda29 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:21.874154 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69091252-14e1-4814-bdb4-f9c45f9dda29 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:21.874569 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69091252-14e1-4814-bdb4-f9c45f9dda29 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:22.007070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-69091252-14e1-4814-bdb4-f9c45f9dda29 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:22.015247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-69091252-14e1-4814-bdb4-f9c45f9dda29 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1264 microversion: 2.1 time: 0.155159 Aug 29 19:09:22.015802 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 372/727] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:21 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:22.094973 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c7bf9583-0d90-4be4-bdb3-3f874c183068 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:22.097119 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c7bf9583-0d90-4be4-bdb3-3f874c183068 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:22.104016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7bf9583-0d90-4be4-bdb3-3f874c183068 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:22.104501 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7bf9583-0d90-4be4-bdb3-3f874c183068 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:22.104938 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7bf9583-0d90-4be4-bdb3-3f874c183068 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:22.105625 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7bf9583-0d90-4be4-bdb3-3f874c183068 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:22.106073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7bf9583-0d90-4be4-bdb3-3f874c183068 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:22.106519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7bf9583-0d90-4be4-bdb3-3f874c183068 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:22.135854 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c7bf9583-0d90-4be4-bdb3-3f874c183068 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044754 Aug 29 19:09:22.136327 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 356/728] 10.222.0.86 () {60 vars in 1343 bytes} [Mon Aug 29 19:09:22 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:09:23.035084 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ebb2b3eb-e64d-44ab-9ac2-095cb6d426d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:23.035707 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ebb2b3eb-e64d-44ab-9ac2-095cb6d426d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:23.042145 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ebb2b3eb-e64d-44ab-9ac2-095cb6d426d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:23.042623 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ebb2b3eb-e64d-44ab-9ac2-095cb6d426d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:23.043109 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ebb2b3eb-e64d-44ab-9ac2-095cb6d426d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:23.043790 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ebb2b3eb-e64d-44ab-9ac2-095cb6d426d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:23.044241 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ebb2b3eb-e64d-44ab-9ac2-095cb6d426d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:23.044748 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ebb2b3eb-e64d-44ab-9ac2-095cb6d426d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:23.148293 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a85af8b9-de44-486f-93c1-559437e45890 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:23.151103 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a85af8b9-de44-486f-93c1-559437e45890 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:23.157388 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a85af8b9-de44-486f-93c1-559437e45890 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:23.157899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a85af8b9-de44-486f-93c1-559437e45890 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:23.158350 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a85af8b9-de44-486f-93c1-559437e45890 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:23.159131 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a85af8b9-de44-486f-93c1-559437e45890 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:23.159658 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a85af8b9-de44-486f-93c1-559437e45890 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:23.160002 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a85af8b9-de44-486f-93c1-559437e45890 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:23.176609 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ebb2b3eb-e64d-44ab-9ac2-095cb6d426d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:23.184433 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ebb2b3eb-e64d-44ab-9ac2-095cb6d426d4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1452 microversion: 2.1 time: 0.153320 Aug 29 19:09:23.184997 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 373/729] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:23 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:23.189424 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a85af8b9-de44-486f-93c1-559437e45890 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045245 Aug 29 19:09:23.189965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 357/730] 10.222.0.86 () {60 vars in 1343 bytes} [Mon Aug 29 19:09:23 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:23.205694 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3f818f79-1154-46ea-8c51-448d0b3269a2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:23.206307 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3f818f79-1154-46ea-8c51-448d0b3269a2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:23.212841 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f818f79-1154-46ea-8c51-448d0b3269a2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:23.213346 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f818f79-1154-46ea-8c51-448d0b3269a2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:23.213815 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f818f79-1154-46ea-8c51-448d0b3269a2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:23.214534 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f818f79-1154-46ea-8c51-448d0b3269a2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:23.215019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f818f79-1154-46ea-8c51-448d0b3269a2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:23.215446 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f818f79-1154-46ea-8c51-448d0b3269a2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:23.252866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0b2e3cdb-1cc4-417a-83f3-3c7c56a64b0d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:23.253355 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0b2e3cdb-1cc4-417a-83f3-3c7c56a64b0d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:23.259563 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0b2e3cdb-1cc4-417a-83f3-3c7c56a64b0d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:23.260041 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0b2e3cdb-1cc4-417a-83f3-3c7c56a64b0d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:23.260467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0b2e3cdb-1cc4-417a-83f3-3c7c56a64b0d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:23.261152 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0b2e3cdb-1cc4-417a-83f3-3c7c56a64b0d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:23.261595 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0b2e3cdb-1cc4-417a-83f3-3c7c56a64b0d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:23.262516 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0b2e3cdb-1cc4-417a-83f3-3c7c56a64b0d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:23.287575 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0b2e3cdb-1cc4-417a-83f3-3c7c56a64b0d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:09:23.354707 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3f818f79-1154-46ea-8c51-448d0b3269a2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:23.365328 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3f818f79-1154-46ea-8c51-448d0b3269a2 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1452 microversion: 2.1 time: 0.163180 Aug 29 19:09:23.365947 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 374/731] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:23 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:23.366679 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0b2e3cdb-1cc4-417a-83f3-3c7c56a64b0d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "DELETE /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 204 len: 0 microversion: 2.20 time: 0.117235 Aug 29 19:09:23.367876 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 358/732] 10.222.0.86 () {60 vars in 1280 bytes} [Mon Aug 29 19:09:23 2022] DELETE /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 19:09:23.375673 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7fcad856-8e2e-44ba-b951-9418a726f68b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:23.376504 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7fcad856-8e2e-44ba-b951-9418a726f68b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:23.384183 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7fcad856-8e2e-44ba-b951-9418a726f68b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:23.384645 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7fcad856-8e2e-44ba-b951-9418a726f68b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:23.385081 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7fcad856-8e2e-44ba-b951-9418a726f68b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:23.385775 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7fcad856-8e2e-44ba-b951-9418a726f68b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:23.386221 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7fcad856-8e2e-44ba-b951-9418a726f68b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:23.386775 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7fcad856-8e2e-44ba-b951-9418a726f68b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:23.521537 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7fcad856-8e2e-44ba-b951-9418a726f68b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:23.529699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7fcad856-8e2e-44ba-b951-9418a726f68b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:23.531165 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7fcad856-8e2e-44ba-b951-9418a726f68b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:23.532323 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7fcad856-8e2e-44ba-b951-9418a726f68b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.160388 Aug 29 19:09:23.533133 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 375/733] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:09:23 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:09:24.555687 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-32bc6290-389d-4373-b952-08cdb0866328 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:24.556376 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-32bc6290-389d-4373-b952-08cdb0866328 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:24.562657 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32bc6290-389d-4373-b952-08cdb0866328 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:24.563115 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32bc6290-389d-4373-b952-08cdb0866328 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:24.563547 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32bc6290-389d-4373-b952-08cdb0866328 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:24.564232 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32bc6290-389d-4373-b952-08cdb0866328 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:24.564680 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32bc6290-389d-4373-b952-08cdb0866328 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:24.565106 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32bc6290-389d-4373-b952-08cdb0866328 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:24.698455 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-32bc6290-389d-4373-b952-08cdb0866328 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:24.706834 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-32bc6290-389d-4373-b952-08cdb0866328 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:24.708419 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-32bc6290-389d-4373-b952-08cdb0866328 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:24.709612 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-32bc6290-389d-4373-b952-08cdb0866328 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.158302 Aug 29 19:09:24.710300 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 359/734] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:09:24 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:09:25.067032 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-611fb386-0fcd-4048-a32d-aa790e55566c req-902b6984-89f3-41cd-aa7d-a7885a529d95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee5a9c09-ea98-4feb-bbe7-f942b9ef1672", "tag": "c815ca56-6391-4ced-92fa-9e28f650e18d"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:25.076811 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-611fb386-0fcd-4048-a32d-aa790e55566c req-902b6984-89f3-41cd-aa7d-a7885a529d95 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:25.077287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-611fb386-0fcd-4048-a32d-aa790e55566c req-902b6984-89f3-41cd-aa7d-a7885a529d95 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:25.077712 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-611fb386-0fcd-4048-a32d-aa790e55566c req-902b6984-89f3-41cd-aa7d-a7885a529d95 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:25.089997 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-611fb386-0fcd-4048-a32d-aa790e55566c req-902b6984-89f3-41cd-aa7d-a7885a529d95 service nova] Creating event network-changed:c815ca56-6391-4ced-92fa-9e28f650e18d for instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 on hv-cinder-85083 Aug 29 19:09:25.095358 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-611fb386-0fcd-4048-a32d-aa790e55566c req-902b6984-89f3-41cd-aa7d-a7885a529d95 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031710 Aug 29 19:09:25.096229 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 376/735] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:25.733161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8f1c595b-8f81-4833-9c62-9cfe79ee1135 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:25.735315 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8f1c595b-8f81-4833-9c62-9cfe79ee1135 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:25.743539 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8f1c595b-8f81-4833-9c62-9cfe79ee1135 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:25.745200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8f1c595b-8f81-4833-9c62-9cfe79ee1135 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:25.745876 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8f1c595b-8f81-4833-9c62-9cfe79ee1135 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:25.747369 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8f1c595b-8f81-4833-9c62-9cfe79ee1135 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:25.748491 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8f1c595b-8f81-4833-9c62-9cfe79ee1135 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:25.749157 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8f1c595b-8f81-4833-9c62-9cfe79ee1135 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:26.286893 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8f1c595b-8f81-4833-9c62-9cfe79ee1135 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:26.296062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8f1c595b-8f81-4833-9c62-9cfe79ee1135 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:26.297758 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8f1c595b-8f81-4833-9c62-9cfe79ee1135 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:26.299510 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8f1c595b-8f81-4833-9c62-9cfe79ee1135 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1723 microversion: 2.20 time: 0.571581 Aug 29 19:09:26.300145 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 360/736] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:09:25 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1723 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:09:26.991329 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-08876390-f3ad-4ca9-8657-ea3a6915266d req-aa926f59-903a-4dd9-a092-b5a9e89f2c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55705ba3-2981-43e1-80e0-29995ee472a9", "name": "network-vif-deleted", "tag": "e7223967-a4dc-4ee2-8b85-82a153b42231"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:27.002562 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-08876390-f3ad-4ca9-8657-ea3a6915266d req-aa926f59-903a-4dd9-a092-b5a9e89f2c85 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:27.003369 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-08876390-f3ad-4ca9-8657-ea3a6915266d req-aa926f59-903a-4dd9-a092-b5a9e89f2c85 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:27.004001 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-08876390-f3ad-4ca9-8657-ea3a6915266d req-aa926f59-903a-4dd9-a092-b5a9e89f2c85 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:27.016785 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-08876390-f3ad-4ca9-8657-ea3a6915266d req-aa926f59-903a-4dd9-a092-b5a9e89f2c85 service nova] Creating event network-vif-deleted:e7223967-a4dc-4ee2-8b85-82a153b42231 for instance 55705ba3-2981-43e1-80e0-29995ee472a9 on hv-cinder-85083 Aug 29 19:09:27.021875 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-08876390-f3ad-4ca9-8657-ea3a6915266d req-aa926f59-903a-4dd9-a092-b5a9e89f2c85 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182527 Aug 29 19:09:27.022579 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 377/737] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:27.322721 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-23bb5b6b-f5b7-402a-b10c-aca08c46b03d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:27.323355 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-23bb5b6b-f5b7-402a-b10c-aca08c46b03d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:27.329955 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-23bb5b6b-f5b7-402a-b10c-aca08c46b03d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:27.330435 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-23bb5b6b-f5b7-402a-b10c-aca08c46b03d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:27.330863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-23bb5b6b-f5b7-402a-b10c-aca08c46b03d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:27.331579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-23bb5b6b-f5b7-402a-b10c-aca08c46b03d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:27.332019 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-23bb5b6b-f5b7-402a-b10c-aca08c46b03d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:27.332434 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-23bb5b6b-f5b7-402a-b10c-aca08c46b03d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:27.364342 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-23bb5b6b-f5b7-402a-b10c-aca08c46b03d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:27.364849 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-23bb5b6b-f5b7-402a-b10c-aca08c46b03d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:27.365279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-23bb5b6b-f5b7-402a-b10c-aca08c46b03d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:27.365721 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-23bb5b6b-f5b7-402a-b10c-aca08c46b03d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lazy-loading 'fault' on Instance uuid 55705ba3-2981-43e1-80e0-29995ee472a9 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:09:27.417715 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-23bb5b6b-f5b7-402a-b10c-aca08c46b03d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:27.426407 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-23bb5b6b-f5b7-402a-b10c-aca08c46b03d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:27.427866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-23bb5b6b-f5b7-402a-b10c-aca08c46b03d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:27.429018 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-23bb5b6b-f5b7-402a-b10c-aca08c46b03d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 200 len: 1371 microversion: 2.20 time: 0.111224 Aug 29 19:09:27.430547 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 361/738] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:09:27 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:09:28.454508 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dc6cd44d-9139-4d3d-97ac-c0ab63aac17d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:28.455241 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dc6cd44d-9139-4d3d-97ac-c0ab63aac17d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:28.462083 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc6cd44d-9139-4d3d-97ac-c0ab63aac17d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:28.462563 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc6cd44d-9139-4d3d-97ac-c0ab63aac17d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:28.463011 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc6cd44d-9139-4d3d-97ac-c0ab63aac17d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:28.463723 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc6cd44d-9139-4d3d-97ac-c0ab63aac17d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:28.464195 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc6cd44d-9139-4d3d-97ac-c0ab63aac17d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:28.464603 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc6cd44d-9139-4d3d-97ac-c0ab63aac17d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:28.477828 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-dc6cd44d-9139-4d3d-97ac-c0ab63aac17d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] HTTP exception thrown: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dc6cd44d-9139-4d3d-97ac-c0ab63aac17d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Request method failure captured: Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 HTTP/1.1 Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ0bwQqs9JR0BF81rnbuthj8pDHYQJZucD8bRN12XnCCq3h1Q9bG1wSaSIdEJFBVBNmnBtHrBi6CekBg_VOT4jh41snDvS3MOrDcGFBfHn5dwzpKZeLRNacsyxJ4Nl5L-c-ilJEDLhljN7FgbYCii7eINuhkGAeeuoPhyCF8blrRJAM Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: b3171bab0ea547d9acc3559f449221eb Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:09:28.479491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:09:28.481489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_b3171bab0ea547d9acc3559f449221eb"}]}] Aug 29 19:09:28.481489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:09:28.481489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: b3171bab0ea547d9acc3559f449221eb Aug 29 19:09:28.481489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:09:28.481489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeShelveTestJSON-487521950-project Aug 29 19:09:28.481489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:09:28.481489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:09:28.481489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: dd013ba83e944ecfa1a2d0a8a0d55101 Aug 29 19:09:28.481489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeShelveTestJSON-487521950-project Aug 29 19:09:28.481489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:09:28.481489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. Aug 29 19:09:28.481489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': '55705ba3-2981-43e1-80e0-29995ee472a9'} Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:09:28.482734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. Aug 29 19:09:28.484451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:09:28.485966 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dc6cd44d-9139-4d3d-97ac-c0ab63aac17d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Returning 404 to user: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:09:28.485966 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dc6cd44d-9139-4d3d-97ac-c0ab63aac17d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 404 len: 111 microversion: 2.20 time: 0.031045 Aug 29 19:09:28.485966 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 378/739] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:09:28 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:09:28.490020 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-51d2784a-74d3-401d-b645-c6605f66fee7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '.version_select at 0x7fb2b9e50820>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:28.510642 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-51d2784a-74d3-401d-b645-c6605f66fee7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-199651159" status: 204 len: 0 microversion: 2.20 time: 0.024585 Aug 29 19:09:28.511246 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 362/740] 10.222.0.86 () {60 vars in 1259 bytes} [Mon Aug 29 19:09:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-199651159 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 19:09:29.216368 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f5b926d0-dcef-4695-b080-5c86ec203522 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Action: 'create', calling method: .version_select at 0x7fb2b9e068b0>, body: {"keypair": {"name": "tempest-keypair-872213877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8oUSJXfVav5T7dwFyRjKKHd9yPPnPcIIhZ+5ZBK0pVQmUqNEluteDz6yqj2Rr6vnofbcXpg22sA7u+be2D8VJYsirtwmsJXAjg4RJBtLW+OuyZmEl0BstpYyYcnmIqJQ=="}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:29.236051 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-f5b926d0-dcef-4695-b080-5c86ec203522 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Getting quotas for project b3171bab0ea547d9acc3559f449221eb. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:09:29.239920 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-f5b926d0-dcef-4695-b080-5c86ec203522 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Getting quotas for user dd013ba83e944ecfa1a2d0a8a0d55101 and project b3171bab0ea547d9acc3559f449221eb. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:09:29.278473 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f5b926d0-dcef-4695-b080-5c86ec203522 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.065917 Aug 29 19:09:29.279099 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 379/741] 10.222.0.86 () {62 vars in 1200 bytes} [Mon Aug 29 19:09:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 19:09:30.557725 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1538303149", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9c0caad-1415-4013-9010-645c48c43ada"}], "security_groups": [{"name": "tempest-securitygroup--1434514941"}], "key_name": "tempest-keypair-872213877", "user_data": "}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:30.659412 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] validate_networks() for [('a9c0caad-1415-4013-9010-645c48c43ada', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:09:31.022537 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:09:31.022984 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:09:31.023511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:09:31.023923 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:09:31.024334 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:09:31.033586 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:31.034112 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:31.034571 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:31.035424 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:31.035881 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:31.036308 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:31.053854 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Getting quotas for project b3171bab0ea547d9acc3559f449221eb. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:09:31.058883 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Getting quotas for user dd013ba83e944ecfa1a2d0a8a0d55101 and project b3171bab0ea547d9acc3559f449221eb. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:09:31.071587 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:09:31.074262 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:09:31.123462 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f4b1481c-2d8d-4c02-8eb9-87a1c85bee6d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.571247 Aug 29 19:09:31.124159 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 363/742] 10.222.0.86 () {62 vars in 1188 bytes} [Mon Aug 29 19:09:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 19:09:31.136054 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-58dcdd73-2613-4458-8167-f3d20db340b8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:31.136656 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-58dcdd73-2613-4458-8167-f3d20db340b8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:31.201823 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-58dcdd73-2613-4458-8167-f3d20db340b8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:31.209724 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-58dcdd73-2613-4458-8167-f3d20db340b8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:31.211231 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-58dcdd73-2613-4458-8167-f3d20db340b8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:31.212354 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-58dcdd73-2613-4458-8167-f3d20db340b8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1281 microversion: 2.20 time: 0.080801 Aug 29 19:09:31.212903 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 380/743] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:09:31 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1281 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:09:32.235087 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8872f956-1368-4e31-97fc-a118329719ad tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:32.235687 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8872f956-1368-4e31-97fc-a118329719ad tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:32.242610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8872f956-1368-4e31-97fc-a118329719ad tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:32.243129 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8872f956-1368-4e31-97fc-a118329719ad tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:32.243571 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8872f956-1368-4e31-97fc-a118329719ad tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:32.244254 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8872f956-1368-4e31-97fc-a118329719ad tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:32.244707 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8872f956-1368-4e31-97fc-a118329719ad tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:32.245132 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8872f956-1368-4e31-97fc-a118329719ad tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:32.250216 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:32.309774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8872f956-1368-4e31-97fc-a118329719ad tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:32.319350 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8872f956-1368-4e31-97fc-a118329719ad tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:32.320812 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8872f956-1368-4e31-97fc-a118329719ad tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:32.322161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8872f956-1368-4e31-97fc-a118329719ad tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1333 microversion: 2.20 time: 0.091331 Aug 29 19:09:32.322707 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 364/744] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:09:32 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:09:33.345065 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-88453989-329f-45d5-8995-aae229e27171 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:33.345825 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-88453989-329f-45d5-8995-aae229e27171 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:33.353472 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-88453989-329f-45d5-8995-aae229e27171 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:33.354109 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-88453989-329f-45d5-8995-aae229e27171 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:33.354644 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-88453989-329f-45d5-8995-aae229e27171 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:33.355471 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-88453989-329f-45d5-8995-aae229e27171 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:33.356106 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-88453989-329f-45d5-8995-aae229e27171 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:33.356750 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-88453989-329f-45d5-8995-aae229e27171 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:33.574831 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-88453989-329f-45d5-8995-aae229e27171 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:33.582965 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-88453989-329f-45d5-8995-aae229e27171 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:33.584510 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-88453989-329f-45d5-8995-aae229e27171 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:33.586156 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-88453989-329f-45d5-8995-aae229e27171 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1407 microversion: 2.20 time: 0.244455 Aug 29 19:09:33.586707 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 381/745] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:09:33 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:09:33.833632 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-306fdb31-deb8-483a-914a-76a41f52aeda req-07396c1b-1f30-419f-8a7f-e752bb2734cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77353c2d-0418-48b1-a87a-2b6d8cc0f96e", "tag": "67ef5167-9ef6-4f02-967f-ca2f8ed4953a"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:33.845904 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-306fdb31-deb8-483a-914a-76a41f52aeda req-07396c1b-1f30-419f-8a7f-e752bb2734cb service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:33.846305 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-306fdb31-deb8-483a-914a-76a41f52aeda req-07396c1b-1f30-419f-8a7f-e752bb2734cb service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:33.846722 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-306fdb31-deb8-483a-914a-76a41f52aeda req-07396c1b-1f30-419f-8a7f-e752bb2734cb service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:33.857677 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-306fdb31-deb8-483a-914a-76a41f52aeda req-07396c1b-1f30-419f-8a7f-e752bb2734cb service nova] Creating event network-changed:67ef5167-9ef6-4f02-967f-ca2f8ed4953a for instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e on hv-cinder-85083 Aug 29 19:09:33.863369 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-306fdb31-deb8-483a-914a-76a41f52aeda req-07396c1b-1f30-419f-8a7f-e752bb2734cb service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033757 Aug 29 19:09:33.863968 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 365/746] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:34.608920 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-00cd8192-4007-4e22-b598-fbf762153555 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:34.609534 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-00cd8192-4007-4e22-b598-fbf762153555 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:34.616044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00cd8192-4007-4e22-b598-fbf762153555 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:34.616529 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00cd8192-4007-4e22-b598-fbf762153555 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:34.617470 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00cd8192-4007-4e22-b598-fbf762153555 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:34.618156 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00cd8192-4007-4e22-b598-fbf762153555 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:34.618611 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00cd8192-4007-4e22-b598-fbf762153555 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:34.619130 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00cd8192-4007-4e22-b598-fbf762153555 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:34.753866 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-00cd8192-4007-4e22-b598-fbf762153555 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:34.758190 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:34.763899 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-00cd8192-4007-4e22-b598-fbf762153555 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:34.765458 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-00cd8192-4007-4e22-b598-fbf762153555 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:34.766645 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-00cd8192-4007-4e22-b598-fbf762153555 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1407 microversion: 2.20 time: 0.161618 Aug 29 19:09:34.767258 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 382/747] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:09:34 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:09:35.791154 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ba145db9-f813-4ee8-b9f0-602d6695ab7b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:35.791837 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ba145db9-f813-4ee8-b9f0-602d6695ab7b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:35.793745 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:35.799241 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba145db9-f813-4ee8-b9f0-602d6695ab7b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:35.799719 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba145db9-f813-4ee8-b9f0-602d6695ab7b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:35.800146 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba145db9-f813-4ee8-b9f0-602d6695ab7b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:35.800849 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba145db9-f813-4ee8-b9f0-602d6695ab7b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:35.801294 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba145db9-f813-4ee8-b9f0-602d6695ab7b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:35.801705 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba145db9-f813-4ee8-b9f0-602d6695ab7b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:35.931363 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ba145db9-f813-4ee8-b9f0-602d6695ab7b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:35.939527 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ba145db9-f813-4ee8-b9f0-602d6695ab7b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:35.941000 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ba145db9-f813-4ee8-b9f0-602d6695ab7b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:35.942094 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ba145db9-f813-4ee8-b9f0-602d6695ab7b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1407 microversion: 2.20 time: 0.156578 Aug 29 19:09:35.942647 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 366/748] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:09:35 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:09:36.965403 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d5fe7089-be33-4652-b4bf-5d86cd47c54f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:36.965961 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d5fe7089-be33-4652-b4bf-5d86cd47c54f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:36.968283 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:36.974477 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d5fe7089-be33-4652-b4bf-5d86cd47c54f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:36.974955 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d5fe7089-be33-4652-b4bf-5d86cd47c54f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:36.975549 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d5fe7089-be33-4652-b4bf-5d86cd47c54f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:36.976232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d5fe7089-be33-4652-b4bf-5d86cd47c54f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:36.976684 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d5fe7089-be33-4652-b4bf-5d86cd47c54f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:36.977109 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d5fe7089-be33-4652-b4bf-5d86cd47c54f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:37.108197 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d5fe7089-be33-4652-b4bf-5d86cd47c54f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:37.116220 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d5fe7089-be33-4652-b4bf-5d86cd47c54f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:37.118330 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d5fe7089-be33-4652-b4bf-5d86cd47c54f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:37.119460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d5fe7089-be33-4652-b4bf-5d86cd47c54f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1407 microversion: 2.20 time: 0.158874 Aug 29 19:09:37.120006 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 383/749] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:09:36 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:09:38.141396 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f59730e3-52f1-4de5-ae2c-c9a0526c0f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:38.142876 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f59730e3-52f1-4de5-ae2c-c9a0526c0f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:38.149813 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f59730e3-52f1-4de5-ae2c-c9a0526c0f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:38.150393 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f59730e3-52f1-4de5-ae2c-c9a0526c0f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:38.151076 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f59730e3-52f1-4de5-ae2c-c9a0526c0f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:38.152141 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f59730e3-52f1-4de5-ae2c-c9a0526c0f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:38.152838 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f59730e3-52f1-4de5-ae2c-c9a0526c0f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:38.153474 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f59730e3-52f1-4de5-ae2c-c9a0526c0f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:38.320942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f59730e3-52f1-4de5-ae2c-c9a0526c0f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:38.329442 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f59730e3-52f1-4de5-ae2c-c9a0526c0f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:38.330947 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f59730e3-52f1-4de5-ae2c-c9a0526c0f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:38.332110 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f59730e3-52f1-4de5-ae2c-c9a0526c0f90 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1407 microversion: 2.20 time: 0.194800 Aug 29 19:09:38.332663 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 367/750] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:09:38 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:09:39.355593 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-00407497-2fb9-46fc-ab37-24bcf4a16aee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:39.356210 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-00407497-2fb9-46fc-ab37-24bcf4a16aee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:39.363885 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00407497-2fb9-46fc-ab37-24bcf4a16aee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:39.364478 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00407497-2fb9-46fc-ab37-24bcf4a16aee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:39.364953 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00407497-2fb9-46fc-ab37-24bcf4a16aee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:39.365765 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00407497-2fb9-46fc-ab37-24bcf4a16aee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:39.366288 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00407497-2fb9-46fc-ab37-24bcf4a16aee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:39.367499 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00407497-2fb9-46fc-ab37-24bcf4a16aee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:39.528460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-00407497-2fb9-46fc-ab37-24bcf4a16aee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:39.538793 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-00407497-2fb9-46fc-ab37-24bcf4a16aee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:39.540895 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-00407497-2fb9-46fc-ab37-24bcf4a16aee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:39.542362 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-00407497-2fb9-46fc-ab37-24bcf4a16aee tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1407 microversion: 2.20 time: 0.191270 Aug 29 19:09:39.542922 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 384/751] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:09:39 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:09:39.579085 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-19fd9db2-33a0-4955-ad3c-db128c26cea8 req-6c9f770b-90ff-45fe-9d9a-8a1ef1536c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77353c2d-0418-48b1-a87a-2b6d8cc0f96e", "name": "network-vif-plugged", "status": "completed", "tag": "67ef5167-9ef6-4f02-967f-ca2f8ed4953a"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:39.589770 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-19fd9db2-33a0-4955-ad3c-db128c26cea8 req-6c9f770b-90ff-45fe-9d9a-8a1ef1536c38 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:39.590334 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-19fd9db2-33a0-4955-ad3c-db128c26cea8 req-6c9f770b-90ff-45fe-9d9a-8a1ef1536c38 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:39.590828 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-19fd9db2-33a0-4955-ad3c-db128c26cea8 req-6c9f770b-90ff-45fe-9d9a-8a1ef1536c38 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:39.602470 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-19fd9db2-33a0-4955-ad3c-db128c26cea8 req-6c9f770b-90ff-45fe-9d9a-8a1ef1536c38 service nova] Creating event network-vif-plugged:67ef5167-9ef6-4f02-967f-ca2f8ed4953a for instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e on hv-cinder-85083 Aug 29 19:09:39.607491 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-19fd9db2-33a0-4955-ad3c-db128c26cea8 req-6c9f770b-90ff-45fe-9d9a-8a1ef1536c38 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031944 Aug 29 19:09:39.608238 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 368/752] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:40.565510 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5da48eb6-622a-4e0c-beed-d8d47adc0eb9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:40.566117 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5da48eb6-622a-4e0c-beed-d8d47adc0eb9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:40.572720 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5da48eb6-622a-4e0c-beed-d8d47adc0eb9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:40.573198 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5da48eb6-622a-4e0c-beed-d8d47adc0eb9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:40.573627 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5da48eb6-622a-4e0c-beed-d8d47adc0eb9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:40.574305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5da48eb6-622a-4e0c-beed-d8d47adc0eb9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:40.574752 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5da48eb6-622a-4e0c-beed-d8d47adc0eb9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:40.575231 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5da48eb6-622a-4e0c-beed-d8d47adc0eb9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:40.701460 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5da48eb6-622a-4e0c-beed-d8d47adc0eb9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:40.709564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5da48eb6-622a-4e0c-beed-d8d47adc0eb9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:40.711556 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5da48eb6-622a-4e0c-beed-d8d47adc0eb9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:40.712650 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5da48eb6-622a-4e0c-beed-d8d47adc0eb9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1407 microversion: 2.20 time: 0.150960 Aug 29 19:09:40.713203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 385/753] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:09:40 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:09:41.733500 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:41.734256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:41.738844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2ad5b75e-8984-490b-b5a7-c5c1c4a93b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:41.739568 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2ad5b75e-8984-490b-b5a7-c5c1c4a93b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:41.746615 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ad5b75e-8984-490b-b5a7-c5c1c4a93b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:41.747130 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ad5b75e-8984-490b-b5a7-c5c1c4a93b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:41.747565 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ad5b75e-8984-490b-b5a7-c5c1c4a93b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:41.748258 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ad5b75e-8984-490b-b5a7-c5c1c4a93b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:41.748710 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ad5b75e-8984-490b-b5a7-c5c1c4a93b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:41.749134 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ad5b75e-8984-490b-b5a7-c5c1c4a93b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:41.886034 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2ad5b75e-8984-490b-b5a7-c5c1c4a93b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:41.894150 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2ad5b75e-8984-490b-b5a7-c5c1c4a93b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:41.895617 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2ad5b75e-8984-490b-b5a7-c5c1c4a93b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:41.896716 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2ad5b75e-8984-490b-b5a7-c5c1c4a93b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1407 microversion: 2.20 time: 0.164665 Aug 29 19:09:41.897304 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 369/754] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:09:41 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:09:42.920130 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-01818ed1-6d81-455e-84ea-9504330017a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:42.920798 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-01818ed1-6d81-455e-84ea-9504330017a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:42.922634 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=6 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:42.928612 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01818ed1-6d81-455e-84ea-9504330017a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:42.929128 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01818ed1-6d81-455e-84ea-9504330017a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:42.929564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01818ed1-6d81-455e-84ea-9504330017a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:42.930253 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01818ed1-6d81-455e-84ea-9504330017a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:42.930706 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01818ed1-6d81-455e-84ea-9504330017a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:42.931165 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01818ed1-6d81-455e-84ea-9504330017a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:43.062356 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-01818ed1-6d81-455e-84ea-9504330017a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:43.070475 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-01818ed1-6d81-455e-84ea-9504330017a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:43.072242 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-01818ed1-6d81-455e-84ea-9504330017a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:43.073366 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-01818ed1-6d81-455e-84ea-9504330017a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1598 microversion: 2.20 time: 0.157167 Aug 29 19:09:43.073928 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 386/755] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:09:42 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:09:43.095799 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-93ac7894-4949-4666-a4ee-4f893f687819 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:43.096318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-93ac7894-4949-4666-a4ee-4f893f687819 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:43.103333 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93ac7894-4949-4666-a4ee-4f893f687819 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:43.103806 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93ac7894-4949-4666-a4ee-4f893f687819 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:43.104236 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93ac7894-4949-4666-a4ee-4f893f687819 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:43.104919 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93ac7894-4949-4666-a4ee-4f893f687819 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:43.105350 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93ac7894-4949-4666-a4ee-4f893f687819 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:43.105763 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93ac7894-4949-4666-a4ee-4f893f687819 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:43.186641 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-93ac7894-4949-4666-a4ee-4f893f687819 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094694 Aug 29 19:09:43.187275 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 370/756] 10.222.0.86 () {60 vars in 1316 bytes} [Mon Aug 29 19:09:43 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 19:09:44.356135 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-dee44b46-a215-4adf-97df-a6e24bb848af req-fba2bd8c-1785-43c6-9a2c-61fc6d43b8ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77353c2d-0418-48b1-a87a-2b6d8cc0f96e", "tag": "67ef5167-9ef6-4f02-967f-ca2f8ed4953a"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:44.366028 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-dee44b46-a215-4adf-97df-a6e24bb848af req-fba2bd8c-1785-43c6-9a2c-61fc6d43b8ad service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:44.366627 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-dee44b46-a215-4adf-97df-a6e24bb848af req-fba2bd8c-1785-43c6-9a2c-61fc6d43b8ad service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:44.367155 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-dee44b46-a215-4adf-97df-a6e24bb848af req-fba2bd8c-1785-43c6-9a2c-61fc6d43b8ad service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:44.378058 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-dee44b46-a215-4adf-97df-a6e24bb848af req-fba2bd8c-1785-43c6-9a2c-61fc6d43b8ad service nova] Creating event network-changed:67ef5167-9ef6-4f02-967f-ca2f8ed4953a for instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e on hv-cinder-85083 Aug 29 19:09:44.383067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-dee44b46-a215-4adf-97df-a6e24bb848af req-fba2bd8c-1785-43c6-9a2c-61fc6d43b8ad service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030530 Aug 29 19:09:44.383651 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 387/757] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:05.256041 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=9 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:05.256785 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=30 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:05.261034 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-67a06efb-0059-4bc1-8591-b4d24e1c4e68 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:05.261523 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-67a06efb-0059-4bc1-8591-b4d24e1c4e68 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:05.268136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67a06efb-0059-4bc1-8591-b4d24e1c4e68 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:05.268624 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67a06efb-0059-4bc1-8591-b4d24e1c4e68 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:05.269054 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67a06efb-0059-4bc1-8591-b4d24e1c4e68 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:05.269741 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67a06efb-0059-4bc1-8591-b4d24e1c4e68 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:05.270196 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67a06efb-0059-4bc1-8591-b4d24e1c4e68 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:05.270626 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67a06efb-0059-4bc1-8591-b4d24e1c4e68 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:05.351876 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-67a06efb-0059-4bc1-8591-b4d24e1c4e68 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lazy-loading 'services' on Instance uuid 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:10:05.464702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-67a06efb-0059-4bc1-8591-b4d24e1c4e68 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "DELETE /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/os-volume_attachments/1284e0d2-8329-4967-8cdb-905198ae8ea1" status: 202 len: 0 microversion: 2.1 time: 0.209790 Aug 29 19:10:05.465423 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 371/758] 10.222.0.86 () {58 vars in 1416 bytes} [Mon Aug 29 19:10:05 2022] DELETE /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/os-volume_attachments/1284e0d2-8329-4967-8cdb-905198ae8ea1 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:10:05.471673 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=9 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:05.472406 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=26 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:05.477222 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-67c6af5a-bcee-44b9-9e9f-385bb67ac030 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:05.479472 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-67c6af5a-bcee-44b9-9e9f-385bb67ac030 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:05.487163 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67c6af5a-bcee-44b9-9e9f-385bb67ac030 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:05.487597 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67c6af5a-bcee-44b9-9e9f-385bb67ac030 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:05.488060 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67c6af5a-bcee-44b9-9e9f-385bb67ac030 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:05.488758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67c6af5a-bcee-44b9-9e9f-385bb67ac030 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:05.489208 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67c6af5a-bcee-44b9-9e9f-385bb67ac030 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:05.489629 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67c6af5a-bcee-44b9-9e9f-385bb67ac030 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:05.526224 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-67c6af5a-bcee-44b9-9e9f-385bb67ac030 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056074 Aug 29 19:10:05.526853 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 388/759] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:10:05 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:06.546560 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-716f3022-abd0-4bb1-b55c-314374c81b11 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:06.548908 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-716f3022-abd0-4bb1-b55c-314374c81b11 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:06.556009 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-716f3022-abd0-4bb1-b55c-314374c81b11 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:06.556489 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-716f3022-abd0-4bb1-b55c-314374c81b11 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:06.560242 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-716f3022-abd0-4bb1-b55c-314374c81b11 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:06.560242 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-716f3022-abd0-4bb1-b55c-314374c81b11 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:06.560242 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-716f3022-abd0-4bb1-b55c-314374c81b11 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:06.560242 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-716f3022-abd0-4bb1-b55c-314374c81b11 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:06.592064 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-716f3022-abd0-4bb1-b55c-314374c81b11 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049692 Aug 29 19:10:06.592988 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 372/760] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:10:06 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:10:06.678719 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7dadb016-674a-4e46-9898-86f83bed9242 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:06.680028 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7dadb016-674a-4e46-9898-86f83bed9242 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:06.686947 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7dadb016-674a-4e46-9898-86f83bed9242 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:06.688429 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7dadb016-674a-4e46-9898-86f83bed9242 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:06.689031 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7dadb016-674a-4e46-9898-86f83bed9242 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:06.689979 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7dadb016-674a-4e46-9898-86f83bed9242 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:06.690702 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7dadb016-674a-4e46-9898-86f83bed9242 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:06.691266 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7dadb016-674a-4e46-9898-86f83bed9242 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:06.718854 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7dadb016-674a-4e46-9898-86f83bed9242 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:10:06.796845 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7dadb016-674a-4e46-9898-86f83bed9242 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "DELETE /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 204 len: 0 microversion: 2.1 time: 0.121911 Aug 29 19:10:06.797741 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 389/761] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:10:06 2022] DELETE /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:10:06.806240 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2bfd004d-041e-4267-aa82-e66e07efa260 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:06.806888 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2bfd004d-041e-4267-aa82-e66e07efa260 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:06.813068 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2bfd004d-041e-4267-aa82-e66e07efa260 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:06.813669 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2bfd004d-041e-4267-aa82-e66e07efa260 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:06.814225 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2bfd004d-041e-4267-aa82-e66e07efa260 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:06.815302 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2bfd004d-041e-4267-aa82-e66e07efa260 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:06.815969 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2bfd004d-041e-4267-aa82-e66e07efa260 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:06.816601 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2bfd004d-041e-4267-aa82-e66e07efa260 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:06.951297 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2bfd004d-041e-4267-aa82-e66e07efa260 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:06.958976 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2bfd004d-041e-4267-aa82-e66e07efa260 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1689 microversion: 2.1 time: 0.157427 Aug 29 19:10:06.959572 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 373/762] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:06 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:07.960862 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2cd4aeed-8b9f-47ce-9fe3-3cd3fab6a557 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:07.963232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2cd4aeed-8b9f-47ce-9fe3-3cd3fab6a557 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:07.969612 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2cd4aeed-8b9f-47ce-9fe3-3cd3fab6a557 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:07.970095 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2cd4aeed-8b9f-47ce-9fe3-3cd3fab6a557 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:07.970530 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2cd4aeed-8b9f-47ce-9fe3-3cd3fab6a557 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:07.971243 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2cd4aeed-8b9f-47ce-9fe3-3cd3fab6a557 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:07.971696 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2cd4aeed-8b9f-47ce-9fe3-3cd3fab6a557 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:07.972119 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2cd4aeed-8b9f-47ce-9fe3-3cd3fab6a557 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:07.980365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b1b6724d-afcf-4474-b36e-b998b44a2492 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:07.980979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b1b6724d-afcf-4474-b36e-b998b44a2492 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:07.987641 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b1b6724d-afcf-4474-b36e-b998b44a2492 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:07.988123 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b1b6724d-afcf-4474-b36e-b998b44a2492 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:07.988572 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b1b6724d-afcf-4474-b36e-b998b44a2492 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:07.989271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b1b6724d-afcf-4474-b36e-b998b44a2492 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:07.989722 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b1b6724d-afcf-4474-b36e-b998b44a2492 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:07.990166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b1b6724d-afcf-4474-b36e-b998b44a2492 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:08.003190 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2cd4aeed-8b9f-47ce-9fe3-3cd3fab6a557 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046749 Aug 29 19:10:08.003753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 390/763] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:10:07 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:10:08.065998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-aaf6ca08-9308-4fbc-bc25-fde3063322e8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:08.066615 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-aaf6ca08-9308-4fbc-bc25-fde3063322e8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:08.072907 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aaf6ca08-9308-4fbc-bc25-fde3063322e8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:08.073391 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aaf6ca08-9308-4fbc-bc25-fde3063322e8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:08.073823 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aaf6ca08-9308-4fbc-bc25-fde3063322e8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:08.074514 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aaf6ca08-9308-4fbc-bc25-fde3063322e8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:08.074968 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aaf6ca08-9308-4fbc-bc25-fde3063322e8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:08.075809 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aaf6ca08-9308-4fbc-bc25-fde3063322e8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:08.101290 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-aaf6ca08-9308-4fbc-bc25-fde3063322e8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:10:08.129019 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b1b6724d-afcf-4474-b36e-b998b44a2492 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:08.137304 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b1b6724d-afcf-4474-b36e-b998b44a2492 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1689 microversion: 2.1 time: 0.160692 Aug 29 19:10:08.137867 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 374/764] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:07 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:08.177673 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-aaf6ca08-9308-4fbc-bc25-fde3063322e8 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "DELETE /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 204 len: 0 microversion: 2.1 time: 0.115271 Aug 29 19:10:08.178173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 391/765] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:10:08 2022] DELETE /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:10:08.186281 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-640f508c-581c-4233-b84d-20336de193ef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:08.186885 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-640f508c-581c-4233-b84d-20336de193ef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:08.193015 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-640f508c-581c-4233-b84d-20336de193ef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:08.193491 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-640f508c-581c-4233-b84d-20336de193ef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:08.194445 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-640f508c-581c-4233-b84d-20336de193ef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:08.195151 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-640f508c-581c-4233-b84d-20336de193ef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:08.195597 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-640f508c-581c-4233-b84d-20336de193ef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:08.196012 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-640f508c-581c-4233-b84d-20336de193ef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:08.325576 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-640f508c-581c-4233-b84d-20336de193ef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:08.333250 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-640f508c-581c-4233-b84d-20336de193ef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1672 microversion: 2.1 time: 0.150885 Aug 29 19:10:08.333816 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 375/766] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:08 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:09.159814 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9cc5b5f4-5022-4ea1-94a3-161c7ea478b9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:09.160511 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9cc5b5f4-5022-4ea1-94a3-161c7ea478b9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:09.172723 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cc5b5f4-5022-4ea1-94a3-161c7ea478b9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:09.173215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cc5b5f4-5022-4ea1-94a3-161c7ea478b9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:09.173653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cc5b5f4-5022-4ea1-94a3-161c7ea478b9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:09.174362 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cc5b5f4-5022-4ea1-94a3-161c7ea478b9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:09.174815 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cc5b5f4-5022-4ea1-94a3-161c7ea478b9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:09.175287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cc5b5f4-5022-4ea1-94a3-161c7ea478b9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:09.320165 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9cc5b5f4-5022-4ea1-94a3-161c7ea478b9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:09.328109 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9cc5b5f4-5022-4ea1-94a3-161c7ea478b9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1689 microversion: 2.1 time: 0.172574 Aug 29 19:10:09.328664 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 392/767] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:09 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:09.358896 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e5e56287-91e6-4c4b-a0d0-a8bd156f7cbf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:09.360079 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e5e56287-91e6-4c4b-a0d0-a8bd156f7cbf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:09.370899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5e56287-91e6-4c4b-a0d0-a8bd156f7cbf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:09.371659 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5e56287-91e6-4c4b-a0d0-a8bd156f7cbf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:09.372337 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5e56287-91e6-4c4b-a0d0-a8bd156f7cbf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:09.373451 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5e56287-91e6-4c4b-a0d0-a8bd156f7cbf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:09.374112 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5e56287-91e6-4c4b-a0d0-a8bd156f7cbf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:09.374919 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5e56287-91e6-4c4b-a0d0-a8bd156f7cbf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:09.505118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e5e56287-91e6-4c4b-a0d0-a8bd156f7cbf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:09.512981 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e5e56287-91e6-4c4b-a0d0-a8bd156f7cbf tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1672 microversion: 2.1 time: 0.161394 Aug 29 19:10:09.513529 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 376/768] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:09 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:10.349131 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dab9ad09-2dbb-4581-a1e9-9dc80fe45362 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:10.349737 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dab9ad09-2dbb-4581-a1e9-9dc80fe45362 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:10.356619 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dab9ad09-2dbb-4581-a1e9-9dc80fe45362 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:10.357113 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dab9ad09-2dbb-4581-a1e9-9dc80fe45362 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:10.357539 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dab9ad09-2dbb-4581-a1e9-9dc80fe45362 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:10.358223 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dab9ad09-2dbb-4581-a1e9-9dc80fe45362 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:10.358675 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dab9ad09-2dbb-4581-a1e9-9dc80fe45362 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:10.359138 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dab9ad09-2dbb-4581-a1e9-9dc80fe45362 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:10.486597 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dab9ad09-2dbb-4581-a1e9-9dc80fe45362 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:10.494172 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dab9ad09-2dbb-4581-a1e9-9dc80fe45362 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1689 microversion: 2.1 time: 0.148939 Aug 29 19:10:10.494726 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 393/769] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:10 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:10.533612 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0d6058d5-4d8c-4674-ac4f-05d5b6faa008 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:10.534217 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0d6058d5-4d8c-4674-ac4f-05d5b6faa008 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:10.541292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d6058d5-4d8c-4674-ac4f-05d5b6faa008 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:10.541770 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d6058d5-4d8c-4674-ac4f-05d5b6faa008 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:10.542197 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d6058d5-4d8c-4674-ac4f-05d5b6faa008 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:10.542874 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d6058d5-4d8c-4674-ac4f-05d5b6faa008 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:10.543354 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d6058d5-4d8c-4674-ac4f-05d5b6faa008 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:10.543779 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d6058d5-4d8c-4674-ac4f-05d5b6faa008 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:10.679581 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0d6058d5-4d8c-4674-ac4f-05d5b6faa008 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:10.687551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0d6058d5-4d8c-4674-ac4f-05d5b6faa008 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1672 microversion: 2.1 time: 0.157540 Aug 29 19:10:10.687998 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 377/770] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:10 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:11.515719 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-929eedfc-68ed-4f77-be6f-719516a88acd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:11.516966 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-929eedfc-68ed-4f77-be6f-719516a88acd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:11.525521 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-929eedfc-68ed-4f77-be6f-719516a88acd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:11.526302 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-929eedfc-68ed-4f77-be6f-719516a88acd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:11.526978 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-929eedfc-68ed-4f77-be6f-719516a88acd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:11.527944 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-929eedfc-68ed-4f77-be6f-719516a88acd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:11.528661 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-929eedfc-68ed-4f77-be6f-719516a88acd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:11.529295 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-929eedfc-68ed-4f77-be6f-719516a88acd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:11.554635 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-e5f3f3df-bc6e-4d85-8b8a-7c0e26c2cdf6 req-58722dc7-17c3-4648-93c7-8a763c78587d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb25d6a-e6bb-4fb7-917c-07041d4509a3", "name": "network-vif-deleted", "tag": "769a3c22-a257-4a0e-ab9e-27222b92bfb1"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:11.566730 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-e5f3f3df-bc6e-4d85-8b8a-7c0e26c2cdf6 req-58722dc7-17c3-4648-93c7-8a763c78587d service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:11.567498 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-e5f3f3df-bc6e-4d85-8b8a-7c0e26c2cdf6 req-58722dc7-17c3-4648-93c7-8a763c78587d service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:11.568092 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-e5f3f3df-bc6e-4d85-8b8a-7c0e26c2cdf6 req-58722dc7-17c3-4648-93c7-8a763c78587d service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:11.580194 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-e5f3f3df-bc6e-4d85-8b8a-7c0e26c2cdf6 req-58722dc7-17c3-4648-93c7-8a763c78587d service nova] Creating event network-vif-deleted:769a3c22-a257-4a0e-ab9e-27222b92bfb1 for instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 on hv-cinder-85083 Aug 29 19:10:11.591917 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-e5f3f3df-bc6e-4d85-8b8a-7c0e26c2cdf6 req-58722dc7-17c3-4648-93c7-8a763c78587d service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040677 Aug 29 19:10:11.592810 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 378/771] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:11.637791 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-929eedfc-68ed-4f77-be6f-719516a88acd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:11.653044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-929eedfc-68ed-4f77-be6f-719516a88acd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1621 microversion: 2.1 time: 0.140732 Aug 29 19:10:11.666353 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 394/772] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:11 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1621 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:11.715541 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d46acbd9-7672-486b-bfe8-e19cba6ac984 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:11.717222 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d46acbd9-7672-486b-bfe8-e19cba6ac984 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:11.738396 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d46acbd9-7672-486b-bfe8-e19cba6ac984 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:11.738890 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d46acbd9-7672-486b-bfe8-e19cba6ac984 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:11.739343 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d46acbd9-7672-486b-bfe8-e19cba6ac984 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:11.740049 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d46acbd9-7672-486b-bfe8-e19cba6ac984 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:11.740685 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d46acbd9-7672-486b-bfe8-e19cba6ac984 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:11.741347 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d46acbd9-7672-486b-bfe8-e19cba6ac984 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:12.025711 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d46acbd9-7672-486b-bfe8-e19cba6ac984 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:12.034032 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d46acbd9-7672-486b-bfe8-e19cba6ac984 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1672 microversion: 2.1 time: 0.329376 Aug 29 19:10:12.042341 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 379/773] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:11 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1672 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:12.278597 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-67301a5e-be0b-4e09-b1b5-4e48dafc9dfe req-8861fe77-bf0d-4094-beff-cba2388d223c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4429ad44-4714-483b-b5b3-0091aabe6905", "name": "network-vif-deleted", "tag": "cf8e3469-e506-47a4-b46f-3674e9c0abab"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:12.293827 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-67301a5e-be0b-4e09-b1b5-4e48dafc9dfe req-8861fe77-bf0d-4094-beff-cba2388d223c service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:12.294263 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-67301a5e-be0b-4e09-b1b5-4e48dafc9dfe req-8861fe77-bf0d-4094-beff-cba2388d223c service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:12.294892 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-67301a5e-be0b-4e09-b1b5-4e48dafc9dfe req-8861fe77-bf0d-4094-beff-cba2388d223c service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:12.313345 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-67301a5e-be0b-4e09-b1b5-4e48dafc9dfe req-8861fe77-bf0d-4094-beff-cba2388d223c service nova] Creating event network-vif-deleted:cf8e3469-e506-47a4-b46f-3674e9c0abab for instance 4429ad44-4714-483b-b5b3-0091aabe6905 on hv-cinder-85083 Aug 29 19:10:12.320200 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-67301a5e-be0b-4e09-b1b5-4e48dafc9dfe req-8861fe77-bf0d-4094-beff-cba2388d223c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051362 Aug 29 19:10:12.321315 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 395/774] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:12.678244 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f1aa22b9-02fb-4f62-b8a0-63dabcf0e453 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:12.678897 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f1aa22b9-02fb-4f62-b8a0-63dabcf0e453 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:12.685393 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1aa22b9-02fb-4f62-b8a0-63dabcf0e453 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:12.686125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1aa22b9-02fb-4f62-b8a0-63dabcf0e453 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:12.686702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1aa22b9-02fb-4f62-b8a0-63dabcf0e453 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:12.687599 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1aa22b9-02fb-4f62-b8a0-63dabcf0e453 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:12.688209 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1aa22b9-02fb-4f62-b8a0-63dabcf0e453 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:12.688783 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1aa22b9-02fb-4f62-b8a0-63dabcf0e453 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:12.723616 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1aa22b9-02fb-4f62-b8a0-63dabcf0e453 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:12.724087 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1aa22b9-02fb-4f62-b8a0-63dabcf0e453 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:12.724515 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1aa22b9-02fb-4f62-b8a0-63dabcf0e453 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:12.724955 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-f1aa22b9-02fb-4f62-b8a0-63dabcf0e453 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lazy-loading 'fault' on Instance uuid 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:10:12.770500 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f1aa22b9-02fb-4f62-b8a0-63dabcf0e453 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:12.778409 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f1aa22b9-02fb-4f62-b8a0-63dabcf0e453 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 200 len: 1335 microversion: 2.1 time: 0.104443 Aug 29 19:10:12.778976 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 380/775] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:12 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 1335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:13.057241 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-00839fa2-ee84-4a71-9a2a-66661f342320 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:13.058028 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-00839fa2-ee84-4a71-9a2a-66661f342320 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:13.064308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00839fa2-ee84-4a71-9a2a-66661f342320 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:13.064791 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00839fa2-ee84-4a71-9a2a-66661f342320 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:13.065226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00839fa2-ee84-4a71-9a2a-66661f342320 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:13.065908 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00839fa2-ee84-4a71-9a2a-66661f342320 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:13.066531 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00839fa2-ee84-4a71-9a2a-66661f342320 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:13.066956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00839fa2-ee84-4a71-9a2a-66661f342320 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:13.099139 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00839fa2-ee84-4a71-9a2a-66661f342320 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:13.099637 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00839fa2-ee84-4a71-9a2a-66661f342320 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:13.100604 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-00839fa2-ee84-4a71-9a2a-66661f342320 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:13.101134 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-00839fa2-ee84-4a71-9a2a-66661f342320 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lazy-loading 'fault' on Instance uuid 4429ad44-4714-483b-b5b3-0091aabe6905 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:10:13.146341 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-00839fa2-ee84-4a71-9a2a-66661f342320 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:13.154373 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-00839fa2-ee84-4a71-9a2a-66661f342320 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 200 len: 1327 microversion: 2.1 time: 0.102419 Aug 29 19:10:13.154937 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 396/776] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:13 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:13.799218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-69affa71-d2f1-4450-914c-42f152cf355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:13.799916 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-69affa71-d2f1-4450-914c-42f152cf355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2fb25d6a-e6bb-4fb7-917c-07041d4509a3] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:13.806909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69affa71-d2f1-4450-914c-42f152cf355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:13.807423 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69affa71-d2f1-4450-914c-42f152cf355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:13.807861 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69affa71-d2f1-4450-914c-42f152cf355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:13.808549 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69affa71-d2f1-4450-914c-42f152cf355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:13.809004 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69affa71-d2f1-4450-914c-42f152cf355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:13.809427 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69affa71-d2f1-4450-914c-42f152cf355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:13.823525 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-69affa71-d2f1-4450-914c-42f152cf355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] HTTP exception thrown: Instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 could not be found. Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-69affa71-d2f1-4450-914c-42f152cf355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Request method failure captured: Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 HTTP/1.1 Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0iXUiYAovRqQ_az3rcpV1ErfEOG6trSM7yEPHZtNh_PNMrhUUN1DHoJV2O5dMcZRrxSKLkM3xKL5tZa-zkwcA48hyuHNQtm_bZy3itxXiOiqM8IYzpwkftFeh9qTl5oUhccTMyqLAPh4AYeWpt5neoT-NEmjsyd5fGZ_d_CGMaZrA Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 4f32b60f5fa8427386bafa1a91f4e608 Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-582562329 Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:10:13.825148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:10:13.826773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4f32b60f5fa8427386bafa1a91f4e608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4f32b60f5fa8427386bafa1a91f4e608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/4f32b60f5fa8427386bafa1a91f4e608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_4f32b60f5fa8427386bafa1a91f4e608"}]}] Aug 29 19:10:13.826773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-ServerRescueNegativeTestJSON-582562329 Aug 29 19:10:13.826773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 4f32b60f5fa8427386bafa1a91f4e608 Aug 29 19:10:13.826773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-582562329 Aug 29 19:10:13.826773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-ServerRescueNegativeTestJSON-582562329-project Aug 29 19:10:13.826773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:10:13.826773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:10:13.826773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: 962284e9a353430881bc119e5f80a890 Aug 29 19:10:13.826773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-ServerRescueNegativeTestJSON-582562329-project Aug 29 19:10:13.826773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:10:13.826773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 could not be found. Aug 29 19:10:13.826773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': '2fb25d6a-e6bb-4fb7-917c-07041d4509a3'} Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 could not be found. Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:10:13.827703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 could not be found. Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 could not be found. Aug 29 19:10:13.829198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:13.830628 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-69affa71-d2f1-4450-914c-42f152cf355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Returning 404 to user: Instance 2fb25d6a-e6bb-4fb7-917c-07041d4509a3 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:10:13.830628 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-69affa71-d2f1-4450-914c-42f152cf355d tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3" status: 404 len: 111 microversion: 2.1 time: 0.031212 Aug 29 19:10:13.830628 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 381/777] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:13 2022] GET /compute/v2.1/servers/2fb25d6a-e6bb-4fb7-917c-07041d4509a3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:10:13.835028 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-89d142a0-d8f3-4124-8adf-ebf5fec79f61 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '.version_select at 0x7fb2b9d98820>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:13.854749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-89d142a0-d8f3-4124-8adf-ebf5fec79f61 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745034498" status: 202 len: 0 microversion: 2.1 time: 0.023496 Aug 29 19:10:13.855343 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 397/778] 10.222.0.86 () {58 vars in 1221 bytes} [Mon Aug 29 19:10:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745034498 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:10:14.177819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9735c87c-265e-4269-b52b-5ab51963ec81 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:14.178954 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9735c87c-265e-4269-b52b-5ab51963ec81 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:14.184801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9735c87c-265e-4269-b52b-5ab51963ec81 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:14.185277 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9735c87c-265e-4269-b52b-5ab51963ec81 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:14.185707 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9735c87c-265e-4269-b52b-5ab51963ec81 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:14.186387 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9735c87c-265e-4269-b52b-5ab51963ec81 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:14.186832 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9735c87c-265e-4269-b52b-5ab51963ec81 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:14.187306 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9735c87c-265e-4269-b52b-5ab51963ec81 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:14.202582 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-9735c87c-265e-4269-b52b-5ab51963ec81 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] HTTP exception thrown: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9735c87c-265e-4269-b52b-5ab51963ec81 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Request method failure captured: Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 HTTP/1.1 Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0flrQm6vNrR-1XPxHS3YIeqRr-zQnpSsObnBMg78QkOkdnuP2tj3QTnx8AkbA5-p1ypfdNP5Jb7Tj4FW2i1Rx72GZVXa1OOc9LSvu2jr2iDubgD86MX0gxM_FS88G2VZgN4W-E_Fo_W_B81GfBD5EL2euYYnSP6aNqInSk5WienCY Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 12c146a9d54f4ed0a4e8a4a835d6367f Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:10:14.204125 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:10:14.205446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_12c146a9d54f4ed0a4e8a4a835d6367f"}]}] Aug 29 19:10:14.205446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:10:14.205446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 12c146a9d54f4ed0a4e8a4a835d6367f Aug 29 19:10:14.205446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:10:14.205446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeTestJSON-817037756-project Aug 29 19:10:14.205446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:10:14.205446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:10:14.205446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: b114570010d94eea955b7b3f1fa97c0a Aug 29 19:10:14.205446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeTestJSON-817037756-project Aug 29 19:10:14.205446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:10:14.205446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. Aug 29 19:10:14.205446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': '4429ad44-4714-483b-b5b3-0091aabe6905'} Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:10:14.206754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. Aug 29 19:10:14.208080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:14.210197 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9735c87c-265e-4269-b52b-5ab51963ec81 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Returning 404 to user: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:10:14.210197 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9735c87c-265e-4269-b52b-5ab51963ec81 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 404 len: 111 microversion: 2.1 time: 0.031719 Aug 29 19:10:14.210197 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 382/779] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:14 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:10:14.215282 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fdd962b4-3404-432f-9c76-0c5fb447a3a5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '.version_select at 0x7fb2b9f54d30>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:14.236127 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fdd962b4-3404-432f-9c76-0c5fb447a3a5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705003565" status: 202 len: 0 microversion: 2.1 time: 0.024705 Aug 29 19:10:14.236847 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 398/780] 10.222.0.86 () {58 vars in 1221 bytes} [Mon Aug 29 19:10:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705003565 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:10:15.169449 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fe432763-57c9-400d-af96-896fd7e0d2f7 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Action: 'create', calling method: .version_select at 0x7fb2b9ebde50>, body: {"keypair": {"name": "tempest-keypair-846177093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+FIHlcVx+BykWGaGxwwg2lc4WTqddAvRxWaVAifLDs3lcj6RJ/qieLHuegHeCKc1ROsIPs2qRb723EBUxZshMtyFnRlWvB9it8Kpdret4zN/qi+82vVwSZX1FisI4ufg=="}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:15.189465 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-fe432763-57c9-400d-af96-896fd7e0d2f7 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Getting quotas for project 12c146a9d54f4ed0a4e8a4a835d6367f. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:10:15.193630 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-fe432763-57c9-400d-af96-896fd7e0d2f7 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Getting quotas for user b114570010d94eea955b7b3f1fa97c0a and project 12c146a9d54f4ed0a4e8a4a835d6367f. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:10:15.216239 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fe432763-57c9-400d-af96-896fd7e0d2f7 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053905 Aug 29 19:10:15.216760 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 383/781] 10.222.0.86 () {60 vars in 1159 bytes} [Mon Aug 29 19:10:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:16.446015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2064558549", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4796b378-18d8-4167-a54f-913080614900"}], "security_groups": [{"name": "tempest-securitygroup--1072474786"}], "key_name": "tempest-keypair-846177093", "user_data": "}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:16.455306 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 19:10:16.455454 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Mon Aug 29 19:10:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.86) !!! Aug 29 19:10:16.550945 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] validate_networks() for [('4796b378-18d8-4167-a54f-913080614900', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:10:16.766747 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-812a5b1b-b719-446b-949d-48d0d1e0f1fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:16.767360 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-812a5b1b-b719-446b-949d-48d0d1e0f1fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:16.774909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-812a5b1b-b719-446b-949d-48d0d1e0f1fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:16.775460 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-812a5b1b-b719-446b-949d-48d0d1e0f1fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:16.775904 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-812a5b1b-b719-446b-949d-48d0d1e0f1fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:16.776727 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-812a5b1b-b719-446b-949d-48d0d1e0f1fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:16.777214 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-812a5b1b-b719-446b-949d-48d0d1e0f1fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:16.777642 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-812a5b1b-b719-446b-949d-48d0d1e0f1fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:16.804018 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-812a5b1b-b719-446b-949d-48d0d1e0f1fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:10:16.882602 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-812a5b1b-b719-446b-949d-48d0d1e0f1fd tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "DELETE /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 204 len: 0 microversion: 2.1 time: 0.120153 Aug 29 19:10:16.883416 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 384/782] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:10:16 2022] DELETE /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:10:16.892209 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4ccfc128-3a39-4d0c-b84b-270fc62d19a7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:16.893006 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4ccfc128-3a39-4d0c-b84b-270fc62d19a7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:16.899014 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4ccfc128-3a39-4d0c-b84b-270fc62d19a7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:16.899505 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4ccfc128-3a39-4d0c-b84b-270fc62d19a7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:16.899942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4ccfc128-3a39-4d0c-b84b-270fc62d19a7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:16.900627 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4ccfc128-3a39-4d0c-b84b-270fc62d19a7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:16.901082 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4ccfc128-3a39-4d0c-b84b-270fc62d19a7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:16.901503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4ccfc128-3a39-4d0c-b84b-270fc62d19a7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:17.312882 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:10:17.313302 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:10:17.313769 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:10:17.314169 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:10:17.314572 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:10:17.324080 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:17.324555 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:17.324982 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:17.325694 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:17.326141 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:17.326556 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:17.339455 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4ccfc128-3a39-4d0c-b84b-270fc62d19a7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:17.343265 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Getting quotas for project 12c146a9d54f4ed0a4e8a4a835d6367f. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:10:17.347198 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Getting quotas for user b114570010d94eea955b7b3f1fa97c0a and project 12c146a9d54f4ed0a4e8a4a835d6367f. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:10:17.347426 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4ccfc128-3a39-4d0c-b84b-270fc62d19a7 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1507 microversion: 2.1 time: 0.459556 Aug 29 19:10:17.347996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 385/783] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:16 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1507 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:17.358226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:10:17.360617 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:10:17.407894 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-76193ddd-ecbc-4f6a-a756-fbad06f58fef tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.966197 Aug 29 19:10:17.408533 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 399/784] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:10:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:10:17.419334 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-73327ed0-7803-45de-9c09-725ed6a6909c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:17.419969 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-73327ed0-7803-45de-9c09-725ed6a6909c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:17.474595 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-73327ed0-7803-45de-9c09-725ed6a6909c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:17.482296 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-73327ed0-7803-45de-9c09-725ed6a6909c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 200 len: 1237 microversion: 2.1 time: 0.066746 Aug 29 19:10:17.483044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 386/785] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:17 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:18.370436 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5dc03218-5a44-45c9-931b-a2380461d005 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:18.371172 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5dc03218-5a44-45c9-931b-a2380461d005 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:18.385891 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5dc03218-5a44-45c9-931b-a2380461d005 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:18.388698 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5dc03218-5a44-45c9-931b-a2380461d005 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:18.389151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5dc03218-5a44-45c9-931b-a2380461d005 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:18.389884 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5dc03218-5a44-45c9-931b-a2380461d005 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:18.390340 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5dc03218-5a44-45c9-931b-a2380461d005 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:18.390760 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5dc03218-5a44-45c9-931b-a2380461d005 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:18.414362 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-fb624e8a-72b5-4939-b782-36086e407b7f req-51f4ba86-281c-415b-96a9-b50952653f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01f30bf-2698-4cae-a884-141ce3b7862a", "name": "network-vif-deleted", "tag": "44e52739-3f46-4693-a6b5-905096ce7217"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:18.425139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-fb624e8a-72b5-4939-b782-36086e407b7f req-51f4ba86-281c-415b-96a9-b50952653f4c service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:18.425616 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-fb624e8a-72b5-4939-b782-36086e407b7f req-51f4ba86-281c-415b-96a9-b50952653f4c service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:18.426043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-fb624e8a-72b5-4939-b782-36086e407b7f req-51f4ba86-281c-415b-96a9-b50952653f4c service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:18.438381 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-fb624e8a-72b5-4939-b782-36086e407b7f req-51f4ba86-281c-415b-96a9-b50952653f4c service nova] Creating event network-vif-deleted:44e52739-3f46-4693-a6b5-905096ce7217 for instance c01f30bf-2698-4cae-a884-141ce3b7862a on hv-cinder-85083 Aug 29 19:10:18.444229 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-fb624e8a-72b5-4939-b782-36086e407b7f req-51f4ba86-281c-415b-96a9-b50952653f4c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033939 Aug 29 19:10:18.445493 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 387/786] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:10:18.459293 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5dc03218-5a44-45c9-931b-a2380461d005 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:18.467689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5dc03218-5a44-45c9-931b-a2380461d005 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1465 microversion: 2.1 time: 0.102610 Aug 29 19:10:18.468263 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 400/787] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:18 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1465 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:18.504133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-965987b6-0385-466b-a822-fd2a407f8124 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:18.504800 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-965987b6-0385-466b-a822-fd2a407f8124 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:18.511661 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-965987b6-0385-466b-a822-fd2a407f8124 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:18.512153 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-965987b6-0385-466b-a822-fd2a407f8124 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:18.512594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-965987b6-0385-466b-a822-fd2a407f8124 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:18.513296 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-965987b6-0385-466b-a822-fd2a407f8124 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:18.513760 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-965987b6-0385-466b-a822-fd2a407f8124 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:18.514187 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-965987b6-0385-466b-a822-fd2a407f8124 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:18.578507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-965987b6-0385-466b-a822-fd2a407f8124 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:18.586174 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-965987b6-0385-466b-a822-fd2a407f8124 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 200 len: 1289 microversion: 2.1 time: 0.086791 Aug 29 19:10:18.586734 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 388/788] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:18 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:19.489068 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c0f94049-bcc2-432f-a8a3-d3cfe0f4996f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:19.489689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c0f94049-bcc2-432f-a8a3-d3cfe0f4996f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:19.496108 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0f94049-bcc2-432f-a8a3-d3cfe0f4996f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:19.496621 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0f94049-bcc2-432f-a8a3-d3cfe0f4996f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:19.497261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0f94049-bcc2-432f-a8a3-d3cfe0f4996f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:19.498422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0f94049-bcc2-432f-a8a3-d3cfe0f4996f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:19.499077 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0f94049-bcc2-432f-a8a3-d3cfe0f4996f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:19.499512 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0f94049-bcc2-432f-a8a3-d3cfe0f4996f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:19.531664 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0f94049-bcc2-432f-a8a3-d3cfe0f4996f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:19.532357 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0f94049-bcc2-432f-a8a3-d3cfe0f4996f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:19.532616 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0f94049-bcc2-432f-a8a3-d3cfe0f4996f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:19.533068 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-c0f94049-bcc2-432f-a8a3-d3cfe0f4996f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lazy-loading 'fault' on Instance uuid c01f30bf-2698-4cae-a884-141ce3b7862a {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:10:19.607805 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1378d088-570d-45da-bc6f-27fd3b668357 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:19.608413 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1378d088-570d-45da-bc6f-27fd3b668357 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:19.611992 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c0f94049-bcc2-432f-a8a3-d3cfe0f4996f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:19.616421 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1378d088-570d-45da-bc6f-27fd3b668357 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:19.616823 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1378d088-570d-45da-bc6f-27fd3b668357 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:19.617991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1378d088-570d-45da-bc6f-27fd3b668357 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:19.618900 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1378d088-570d-45da-bc6f-27fd3b668357 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:19.619614 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1378d088-570d-45da-bc6f-27fd3b668357 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:19.620393 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c0f94049-bcc2-432f-a8a3-d3cfe0f4996f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 200 len: 1311 microversion: 2.1 time: 0.135399 Aug 29 19:10:19.620764 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1378d088-570d-45da-bc6f-27fd3b668357 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:19.620973 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 401/789] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:19 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 1311 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:19.643642 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:19.796380 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1378d088-570d-45da-bc6f-27fd3b668357 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:19.805370 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1378d088-570d-45da-bc6f-27fd3b668357 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 200 len: 1363 microversion: 2.1 time: 0.201500 Aug 29 19:10:19.805949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 389/790] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:19 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:20.475712 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-84702de9-f375-4b33-acf2-0a690c282ef4 req-9c790003-a851-43d0-a2f3-a98df4712cef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81db0eba-3d09-45c7-bf0a-143e09b8b69d", "tag": "0df5eb8e-bdb7-4ec2-b414-5ce238d4948d"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:20.485078 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-84702de9-f375-4b33-acf2-0a690c282ef4 req-9c790003-a851-43d0-a2f3-a98df4712cef service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:20.485799 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-84702de9-f375-4b33-acf2-0a690c282ef4 req-9c790003-a851-43d0-a2f3-a98df4712cef service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:20.486224 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-84702de9-f375-4b33-acf2-0a690c282ef4 req-9c790003-a851-43d0-a2f3-a98df4712cef service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:20.498435 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-84702de9-f375-4b33-acf2-0a690c282ef4 req-9c790003-a851-43d0-a2f3-a98df4712cef service nova] Creating event network-changed:0df5eb8e-bdb7-4ec2-b414-5ce238d4948d for instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d on hv-cinder-85083 Aug 29 19:10:20.503675 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-84702de9-f375-4b33-acf2-0a690c282ef4 req-9c790003-a851-43d0-a2f3-a98df4712cef service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031540 Aug 29 19:10:20.504262 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 402/791] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:20.641545 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-413e3a63-c578-46f8-9582-bb8582f57cca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:20.642251 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-413e3a63-c578-46f8-9582-bb8582f57cca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: c01f30bf-2698-4cae-a884-141ce3b7862a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:20.649135 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-413e3a63-c578-46f8-9582-bb8582f57cca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:20.649615 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-413e3a63-c578-46f8-9582-bb8582f57cca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:20.650047 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-413e3a63-c578-46f8-9582-bb8582f57cca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:20.650734 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-413e3a63-c578-46f8-9582-bb8582f57cca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:20.651209 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-413e3a63-c578-46f8-9582-bb8582f57cca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:20.651631 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-413e3a63-c578-46f8-9582-bb8582f57cca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:20.666152 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-413e3a63-c578-46f8-9582-bb8582f57cca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] HTTP exception thrown: Instance c01f30bf-2698-4cae-a884-141ce3b7862a could not be found. Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-413e3a63-c578-46f8-9582-bb8582f57cca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Request method failure captured: Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a HTTP/1.1 Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0iXUiYAovRqQ_az3rcpV1ErfEOG6trSM7yEPHZtNh_PNMrhUUN1DHoJV2O5dMcZRrxSKLkM3xKL5tZa-zkwcA48hyuHNQtm_bZy3itxXiOiqM8IYzpwkftFeh9qTl5oUhccTMyqLAPh4AYeWpt5neoT-NEmjsyd5fGZ_d_CGMaZrA Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 4f32b60f5fa8427386bafa1a91f4e608 Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-582562329 Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:10:20.667814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:10:20.669379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4f32b60f5fa8427386bafa1a91f4e608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4f32b60f5fa8427386bafa1a91f4e608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/4f32b60f5fa8427386bafa1a91f4e608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_4f32b60f5fa8427386bafa1a91f4e608"}]}] Aug 29 19:10:20.669379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-ServerRescueNegativeTestJSON-582562329 Aug 29 19:10:20.669379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 4f32b60f5fa8427386bafa1a91f4e608 Aug 29 19:10:20.669379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-582562329 Aug 29 19:10:20.669379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-ServerRescueNegativeTestJSON-582562329-project Aug 29 19:10:20.669379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:10:20.669379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:10:20.669379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: 962284e9a353430881bc119e5f80a890 Aug 29 19:10:20.669379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-ServerRescueNegativeTestJSON-582562329-project Aug 29 19:10:20.669379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:10:20.669379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance c01f30bf-2698-4cae-a884-141ce3b7862a could not be found. Aug 29 19:10:20.669379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': 'c01f30bf-2698-4cae-a884-141ce3b7862a'} Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c01f30bf-2698-4cae-a884-141ce3b7862a could not be found. Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:10:20.670282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c01f30bf-2698-4cae-a884-141ce3b7862a could not be found. Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c01f30bf-2698-4cae-a884-141ce3b7862a could not be found. Aug 29 19:10:20.671720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:20.673153 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-413e3a63-c578-46f8-9582-bb8582f57cca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Returning 404 to user: Instance c01f30bf-2698-4cae-a884-141ce3b7862a could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:10:20.673153 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-413e3a63-c578-46f8-9582-bb8582f57cca tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a" status: 404 len: 111 microversion: 2.1 time: 0.031459 Aug 29 19:10:20.673153 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 390/792] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:20 2022] GET /compute/v2.1/servers/c01f30bf-2698-4cae-a884-141ce3b7862a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:10:20.679690 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a181a5b1-9ae0-432e-b04c-d135bfbd7705 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:20.680271 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a181a5b1-9ae0-432e-b04c-d135bfbd7705 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:20.686917 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a181a5b1-9ae0-432e-b04c-d135bfbd7705 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:20.687436 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a181a5b1-9ae0-432e-b04c-d135bfbd7705 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:20.687868 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a181a5b1-9ae0-432e-b04c-d135bfbd7705 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:20.688558 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a181a5b1-9ae0-432e-b04c-d135bfbd7705 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:20.689006 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a181a5b1-9ae0-432e-b04c-d135bfbd7705 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:20.689429 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a181a5b1-9ae0-432e-b04c-d135bfbd7705 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:20.717047 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a181a5b1-9ae0-432e-b04c-d135bfbd7705 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:10:20.744802 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:20.805111 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a181a5b1-9ae0-432e-b04c-d135bfbd7705 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "DELETE /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 204 len: 0 microversion: 2.1 time: 0.130076 Aug 29 19:10:20.805944 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 403/793] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:10:20 2022] DELETE /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:10:20.814614 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-98e0bbcb-4b2c-47e9-ab2b-3e3cf3904ec9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:20.815434 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-98e0bbcb-4b2c-47e9-ab2b-3e3cf3904ec9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:20.821372 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-98e0bbcb-4b2c-47e9-ab2b-3e3cf3904ec9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:20.821861 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-98e0bbcb-4b2c-47e9-ab2b-3e3cf3904ec9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:20.822295 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-98e0bbcb-4b2c-47e9-ab2b-3e3cf3904ec9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:20.823273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-98e0bbcb-4b2c-47e9-ab2b-3e3cf3904ec9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:20.823723 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-98e0bbcb-4b2c-47e9-ab2b-3e3cf3904ec9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:20.824146 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-98e0bbcb-4b2c-47e9-ab2b-3e3cf3904ec9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:20.827644 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5f72f5b1-7fbd-427b-8dda-c516e965230e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:20.828457 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5f72f5b1-7fbd-427b-8dda-c516e965230e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:20.835070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f72f5b1-7fbd-427b-8dda-c516e965230e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:20.835576 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f72f5b1-7fbd-427b-8dda-c516e965230e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:20.836043 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f72f5b1-7fbd-427b-8dda-c516e965230e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:20.836884 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f72f5b1-7fbd-427b-8dda-c516e965230e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:20.837348 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f72f5b1-7fbd-427b-8dda-c516e965230e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:20.837770 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f72f5b1-7fbd-427b-8dda-c516e965230e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:21.043428 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-98e0bbcb-4b2c-47e9-ab2b-3e3cf3904ec9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:21.050508 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5f72f5b1-7fbd-427b-8dda-c516e965230e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:21.051067 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-98e0bbcb-4b2c-47e9-ab2b-3e3cf3904ec9 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.240989 Aug 29 19:10:21.052039 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 391/794] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:20 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:21.058561 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5f72f5b1-7fbd-427b-8dda-c516e965230e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 200 len: 1363 microversion: 2.1 time: 0.236371 Aug 29 19:10:21.059158 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 404/795] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:20 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:22.073092 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2c5e3724-c361-4117-8208-2a55610c59f3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:22.073698 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2c5e3724-c361-4117-8208-2a55610c59f3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:22.080266 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c5e3724-c361-4117-8208-2a55610c59f3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.080664 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e80c7082-3ac1-4949-bf5b-6686e6ad9248 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:22.081089 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c5e3724-c361-4117-8208-2a55610c59f3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.081218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c5e3724-c361-4117-8208-2a55610c59f3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.081318 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e80c7082-3ac1-4949-bf5b-6686e6ad9248 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:22.081827 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c5e3724-c361-4117-8208-2a55610c59f3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.082367 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c5e3724-c361-4117-8208-2a55610c59f3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.082782 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c5e3724-c361-4117-8208-2a55610c59f3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.087701 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e80c7082-3ac1-4949-bf5b-6686e6ad9248 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.088190 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e80c7082-3ac1-4949-bf5b-6686e6ad9248 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.088626 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e80c7082-3ac1-4949-bf5b-6686e6ad9248 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.089322 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e80c7082-3ac1-4949-bf5b-6686e6ad9248 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.089777 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e80c7082-3ac1-4949-bf5b-6686e6ad9248 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.090200 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e80c7082-3ac1-4949-bf5b-6686e6ad9248 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.279449 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2c5e3724-c361-4117-8208-2a55610c59f3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:22.283390 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e80c7082-3ac1-4949-bf5b-6686e6ad9248 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:22.287986 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2c5e3724-c361-4117-8208-2a55610c59f3 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.219148 Aug 29 19:10:22.288633 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 392/796] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:22 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:22.291489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e80c7082-3ac1-4949-bf5b-6686e6ad9248 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 200 len: 1363 microversion: 2.1 time: 0.214628 Aug 29 19:10:22.292043 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 405/797] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:22 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:23.308997 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a4fd1a55-a177-4d54-9f22-1d3bd38eacac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:23.309682 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a4fd1a55-a177-4d54-9f22-1d3bd38eacac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:23.312501 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a41dc24e-3a85-45b0-9ffe-80574f960227 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:23.313260 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a41dc24e-3a85-45b0-9ffe-80574f960227 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:23.316028 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4fd1a55-a177-4d54-9f22-1d3bd38eacac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:23.316540 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4fd1a55-a177-4d54-9f22-1d3bd38eacac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:23.316970 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4fd1a55-a177-4d54-9f22-1d3bd38eacac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:23.317652 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4fd1a55-a177-4d54-9f22-1d3bd38eacac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:23.318100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4fd1a55-a177-4d54-9f22-1d3bd38eacac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:23.318519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4fd1a55-a177-4d54-9f22-1d3bd38eacac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:23.319641 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a41dc24e-3a85-45b0-9ffe-80574f960227 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:23.320125 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a41dc24e-3a85-45b0-9ffe-80574f960227 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:23.320560 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a41dc24e-3a85-45b0-9ffe-80574f960227 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:23.321435 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a41dc24e-3a85-45b0-9ffe-80574f960227 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:23.321897 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a41dc24e-3a85-45b0-9ffe-80574f960227 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:23.322316 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a41dc24e-3a85-45b0-9ffe-80574f960227 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:23.513769 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a4fd1a55-a177-4d54-9f22-1d3bd38eacac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:23.520597 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a41dc24e-3a85-45b0-9ffe-80574f960227 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:23.521565 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a4fd1a55-a177-4d54-9f22-1d3bd38eacac tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.216390 Aug 29 19:10:23.522770 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 393/798] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:23 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:23.529170 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a41dc24e-3a85-45b0-9ffe-80574f960227 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 200 len: 1363 microversion: 2.1 time: 0.220326 Aug 29 19:10:23.529835 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 406/799] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:23 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:24.546397 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9831bf5a-0003-475e-aea4-e638f80aa71f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:24.548167 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9831bf5a-0003-475e-aea4-e638f80aa71f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:24.550871 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dd78bb5c-17c7-43a7-b6ec-7d62faef7f04 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:24.551711 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dd78bb5c-17c7-43a7-b6ec-7d62faef7f04 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:24.560802 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd78bb5c-17c7-43a7-b6ec-7d62faef7f04 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:24.560802 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd78bb5c-17c7-43a7-b6ec-7d62faef7f04 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:24.561273 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd78bb5c-17c7-43a7-b6ec-7d62faef7f04 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:24.561441 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9831bf5a-0003-475e-aea4-e638f80aa71f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:24.561990 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd78bb5c-17c7-43a7-b6ec-7d62faef7f04 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:24.562588 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd78bb5c-17c7-43a7-b6ec-7d62faef7f04 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:24.562726 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9831bf5a-0003-475e-aea4-e638f80aa71f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:24.563036 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd78bb5c-17c7-43a7-b6ec-7d62faef7f04 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:24.564323 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9831bf5a-0003-475e-aea4-e638f80aa71f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:24.565333 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9831bf5a-0003-475e-aea4-e638f80aa71f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:24.565795 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9831bf5a-0003-475e-aea4-e638f80aa71f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:24.566853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9831bf5a-0003-475e-aea4-e638f80aa71f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:24.870901 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dd78bb5c-17c7-43a7-b6ec-7d62faef7f04 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:24.878809 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dd78bb5c-17c7-43a7-b6ec-7d62faef7f04 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 200 len: 1363 microversion: 2.1 time: 0.332439 Aug 29 19:10:24.892056 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 407/800] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:24 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 1363 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:24.896265 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9831bf5a-0003-475e-aea4-e638f80aa71f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962284e9a353430881bc119e5f80a890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f32b60f5fa8427386bafa1a91f4e608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:24.900964 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-07915bef-c39e-4efb-8ad2-6e714ab0ab09 req-291181e3-3b9e-4517-83aa-4a42c898bfe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e88e76a-d978-4b39-89f0-d1dd5a154250", "name": "network-vif-deleted", "tag": "9b7379ea-5177-4f98-8727-d75f6b260a12"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:24.915274 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-07915bef-c39e-4efb-8ad2-6e714ab0ab09 req-291181e3-3b9e-4517-83aa-4a42c898bfe4 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:24.915709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9831bf5a-0003-475e-aea4-e638f80aa71f tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 200 len: 1522 microversion: 2.1 time: 0.374687 Aug 29 19:10:24.915841 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-07915bef-c39e-4efb-8ad2-6e714ab0ab09 req-291181e3-3b9e-4517-83aa-4a42c898bfe4 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:24.916204 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-07915bef-c39e-4efb-8ad2-6e714ab0ab09 req-291181e3-3b9e-4517-83aa-4a42c898bfe4 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:24.916576 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 394/801] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:24 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:24.927305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-07915bef-c39e-4efb-8ad2-6e714ab0ab09 req-291181e3-3b9e-4517-83aa-4a42c898bfe4 service nova] Creating event network-vif-deleted:9b7379ea-5177-4f98-8727-d75f6b260a12 for instance 2e88e76a-d978-4b39-89f0-d1dd5a154250 on hv-cinder-85083 Aug 29 19:10:24.932134 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-07915bef-c39e-4efb-8ad2-6e714ab0ab09 req-291181e3-3b9e-4517-83aa-4a42c898bfe4 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039386 Aug 29 19:10:24.932722 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 408/802] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:25.802363 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-ba129151-baa1-4c68-ba57-047f181866d2 req-2bd8885f-ae99-4331-8b17-795513c2386c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81db0eba-3d09-45c7-bf0a-143e09b8b69d", "name": "network-vif-plugged", "status": "completed", "tag": "0df5eb8e-bdb7-4ec2-b414-5ce238d4948d"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:25.812805 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ba129151-baa1-4c68-ba57-047f181866d2 req-2bd8885f-ae99-4331-8b17-795513c2386c service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:25.813282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ba129151-baa1-4c68-ba57-047f181866d2 req-2bd8885f-ae99-4331-8b17-795513c2386c service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:25.813712 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ba129151-baa1-4c68-ba57-047f181866d2 req-2bd8885f-ae99-4331-8b17-795513c2386c service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:25.825853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-ba129151-baa1-4c68-ba57-047f181866d2 req-2bd8885f-ae99-4331-8b17-795513c2386c service nova] Creating event network-vif-plugged:0df5eb8e-bdb7-4ec2-b414-5ce238d4948d for instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d on hv-cinder-85083 Aug 29 19:10:25.830721 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-ba129151-baa1-4c68-ba57-047f181866d2 req-2bd8885f-ae99-4331-8b17-795513c2386c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032011 Aug 29 19:10:25.831655 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 395/803] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:25.900696 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-75a01bd6-1e94-48f2-88b1-dba32c9eaf7a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:25.902093 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-75a01bd6-1e94-48f2-88b1-dba32c9eaf7a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:25.908448 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-75a01bd6-1e94-48f2-88b1-dba32c9eaf7a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:25.908912 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-75a01bd6-1e94-48f2-88b1-dba32c9eaf7a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:25.909350 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-75a01bd6-1e94-48f2-88b1-dba32c9eaf7a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:25.910039 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-75a01bd6-1e94-48f2-88b1-dba32c9eaf7a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:25.910491 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-75a01bd6-1e94-48f2-88b1-dba32c9eaf7a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:25.910916 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-75a01bd6-1e94-48f2-88b1-dba32c9eaf7a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:25.937160 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7c3a3f79-c3b8-4679-b1db-cd8d38f37c01 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:25.938058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7c3a3f79-c3b8-4679-b1db-cd8d38f37c01 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] [instance: 2e88e76a-d978-4b39-89f0-d1dd5a154250] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:25.944892 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7c3a3f79-c3b8-4679-b1db-cd8d38f37c01 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:25.947096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7c3a3f79-c3b8-4679-b1db-cd8d38f37c01 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:25.947802 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7c3a3f79-c3b8-4679-b1db-cd8d38f37c01 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:25.948522 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7c3a3f79-c3b8-4679-b1db-cd8d38f37c01 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:25.948979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7c3a3f79-c3b8-4679-b1db-cd8d38f37c01 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:25.949403 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7c3a3f79-c3b8-4679-b1db-cd8d38f37c01 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:25.964059 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-7c3a3f79-c3b8-4679-b1db-cd8d38f37c01 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] HTTP exception thrown: Instance 2e88e76a-d978-4b39-89f0-d1dd5a154250 could not be found. Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7c3a3f79-c3b8-4679-b1db-cd8d38f37c01 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Request method failure captured: Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 HTTP/1.1 Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0iXUiYAovRqQ_az3rcpV1ErfEOG6trSM7yEPHZtNh_PNMrhUUN1DHoJV2O5dMcZRrxSKLkM3xKL5tZa-zkwcA48hyuHNQtm_bZy3itxXiOiqM8IYzpwkftFeh9qTl5oUhccTMyqLAPh4AYeWpt5neoT-NEmjsyd5fGZ_d_CGMaZrA Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 4f32b60f5fa8427386bafa1a91f4e608 Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-582562329 Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:10:25.966073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:10:25.967542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4f32b60f5fa8427386bafa1a91f4e608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/4f32b60f5fa8427386bafa1a91f4e608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/4f32b60f5fa8427386bafa1a91f4e608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_4f32b60f5fa8427386bafa1a91f4e608"}]}] Aug 29 19:10:25.967542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-ServerRescueNegativeTestJSON-582562329 Aug 29 19:10:25.967542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 4f32b60f5fa8427386bafa1a91f4e608 Aug 29 19:10:25.967542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-582562329 Aug 29 19:10:25.967542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-ServerRescueNegativeTestJSON-582562329-project Aug 29 19:10:25.967542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:10:25.967542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:10:25.967542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: 962284e9a353430881bc119e5f80a890 Aug 29 19:10:25.967542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-ServerRescueNegativeTestJSON-582562329-project Aug 29 19:10:25.967542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:10:25.967542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance 2e88e76a-d978-4b39-89f0-d1dd5a154250 could not be found. Aug 29 19:10:25.967542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': '2e88e76a-d978-4b39-89f0-d1dd5a154250'} Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e88e76a-d978-4b39-89f0-d1dd5a154250 could not be found. Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:10:25.968899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e88e76a-d978-4b39-89f0-d1dd5a154250 could not be found. Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e88e76a-d978-4b39-89f0-d1dd5a154250 could not be found. Aug 29 19:10:25.970774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:25.972235 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7c3a3f79-c3b8-4679-b1db-cd8d38f37c01 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] Returning 404 to user: Instance 2e88e76a-d978-4b39-89f0-d1dd5a154250 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:10:25.972235 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7c3a3f79-c3b8-4679-b1db-cd8d38f37c01 tempest-ServerRescueNegativeTestJSON-582562329 tempest-ServerRescueNegativeTestJSON-582562329-project] 10.222.0.86 "GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250" status: 404 len: 111 microversion: 2.1 time: 0.034797 Aug 29 19:10:25.972235 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 396/804] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:25 2022] GET /compute/v2.1/servers/2e88e76a-d978-4b39-89f0-d1dd5a154250 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:10:26.082827 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-75a01bd6-1e94-48f2-88b1-dba32c9eaf7a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:26.091869 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-75a01bd6-1e94-48f2-88b1-dba32c9eaf7a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 200 len: 1363 microversion: 2.1 time: 0.196495 Aug 29 19:10:26.092450 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 409/805] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:25 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:27.113104 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9564bd53-25a0-48a1-8914-270366dc42c2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:27.113729 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9564bd53-25a0-48a1-8914-270366dc42c2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:27.120101 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9564bd53-25a0-48a1-8914-270366dc42c2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:27.120582 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9564bd53-25a0-48a1-8914-270366dc42c2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:27.121016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9564bd53-25a0-48a1-8914-270366dc42c2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:27.121708 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9564bd53-25a0-48a1-8914-270366dc42c2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:27.122158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9564bd53-25a0-48a1-8914-270366dc42c2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:27.122892 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9564bd53-25a0-48a1-8914-270366dc42c2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:27.257408 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9564bd53-25a0-48a1-8914-270366dc42c2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:27.265296 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9564bd53-25a0-48a1-8914-270366dc42c2 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 200 len: 1363 microversion: 2.1 time: 0.156074 Aug 29 19:10:27.265852 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 397/806] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:27 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:28.287939 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ad645dbb-0d1f-4bff-bff2-bffe5e01e2ff tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:28.289129 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ad645dbb-0d1f-4bff-bff2-bffe5e01e2ff tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:28.291927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:28.293283 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=6 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:28.301616 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad645dbb-0d1f-4bff-bff2-bffe5e01e2ff tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:28.303799 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad645dbb-0d1f-4bff-bff2-bffe5e01e2ff tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:28.304738 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad645dbb-0d1f-4bff-bff2-bffe5e01e2ff tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:28.306277 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad645dbb-0d1f-4bff-bff2-bffe5e01e2ff tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:28.307289 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad645dbb-0d1f-4bff-bff2-bffe5e01e2ff tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:28.308091 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad645dbb-0d1f-4bff-bff2-bffe5e01e2ff tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:28.513874 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ad645dbb-0d1f-4bff-bff2-bffe5e01e2ff tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:28.521729 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ad645dbb-0d1f-4bff-bff2-bffe5e01e2ff tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 200 len: 1549 microversion: 2.1 time: 0.239871 Aug 29 19:10:28.522521 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 410/807] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:28 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 1549 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:28.543261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-58e865c6-86fb-4883-992a-21d6d3ffe8df tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:28.543875 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-58e865c6-86fb-4883-992a-21d6d3ffe8df tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:28.545899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:28.551794 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-58e865c6-86fb-4883-992a-21d6d3ffe8df tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:28.552279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-58e865c6-86fb-4883-992a-21d6d3ffe8df tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:28.552710 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-58e865c6-86fb-4883-992a-21d6d3ffe8df tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:28.553900 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-58e865c6-86fb-4883-992a-21d6d3ffe8df tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:28.554560 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-58e865c6-86fb-4883-992a-21d6d3ffe8df tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:28.554894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-58e865c6-86fb-4883-992a-21d6d3ffe8df tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:28.675383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-58e865c6-86fb-4883-992a-21d6d3ffe8df tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135869 Aug 29 19:10:28.676531 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 398/808] 10.222.0.86 () {58 vars in 1275 bytes} [Mon Aug 29 19:10:28 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:29.987287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-39137cf6-a373-451a-bf83-a14107facf52 req-0efc5b6e-f0ce-4836-ab23-43295604ce66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81db0eba-3d09-45c7-bf0a-143e09b8b69d", "tag": "0df5eb8e-bdb7-4ec2-b414-5ce238d4948d"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:29.999423 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-39137cf6-a373-451a-bf83-a14107facf52 req-0efc5b6e-f0ce-4836-ab23-43295604ce66 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:29.999908 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-39137cf6-a373-451a-bf83-a14107facf52 req-0efc5b6e-f0ce-4836-ab23-43295604ce66 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:30.000337 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-39137cf6-a373-451a-bf83-a14107facf52 req-0efc5b6e-f0ce-4836-ab23-43295604ce66 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:30.017219 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-39137cf6-a373-451a-bf83-a14107facf52 req-0efc5b6e-f0ce-4836-ab23-43295604ce66 service nova] Creating event network-changed:0df5eb8e-bdb7-4ec2-b414-5ce238d4948d for instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d on hv-cinder-85083 Aug 29 19:10:30.022600 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-39137cf6-a373-451a-bf83-a14107facf52 req-0efc5b6e-f0ce-4836-ab23-43295604ce66 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039820 Aug 29 19:10:30.023446 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 411/809] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:30.585513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-533d9d3d-526c-4b35-8f19-1c0a8a47cbad tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Action: 'create', calling method: .version_select at 0x7fb2bd5e2b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-142713683", "metadata": {"Type": "work"}}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-533d9d3d-526c-4b35-8f19-1c0a8a47cbad tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Request method failure captured: Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 121 Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ8mKKAQv_WFaERzqF7f2ToojCCf3MSpj0c4RRbwtrGsX04uPsqkdMWhr6Tiljne-1uFJMCfiRwdJnzQSFuGnTUKwc1skdOtqwbwFkm6a01-9zrysfoYh0feuQ2qJhIPs78gp20lg9nezVAr2sQGbCA0m-fTtq_DjKh65xOIWWlImBI Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 8e483c67faaf4b7e952919ce5174da35 Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:10:30.596272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:10:30.597911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_8e483c67faaf4b7e952919ce5174da35"}]}] Aug 29 19:10:30.597911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.597911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 8e483c67faaf4b7e952919ce5174da35 Aug 29 19:10:30.597911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.597911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesNegativeTest-182901272-project Aug 29 19:10:30.597911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:10:30.597911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:10:30.597911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: f61d3852c17d468dbbd897af74e7dd8f Aug 29 19:10:30.597911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesNegativeTest-182901272-project Aug 29 19:10:30.597911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Aug 29 19:10:30.597911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-142713683", "metadata": {"Type": "work"}}} Aug 29 19:10:30.597911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: Aug 29 19:10:30.597911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-142713683', 'metadata': {'Type': 'work'}}}} Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise error Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:10:30.600654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 19:10:30.602273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 19:10:30.603647 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 19:10:30.603647 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.603647 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-533d9d3d-526c-4b35-8f19-1c0a8a47cbad tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:10:30.603647 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-533d9d3d-526c-4b35-8f19-1c0a8a47cbad tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.158603 Aug 29 19:10:30.603647 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 399/810] 10.222.0.86 () {60 vars in 1156 bytes} [Mon Aug 29 19:10:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 19:10:30.610354 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-67c4624f-d065-47a3-913a-2b44bc61c46a tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Action: 'create', calling method: .version_select at 0x7fb2b9cf5ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2088066717", "metadata": {"Type": "work"}}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-67c4624f-d065-47a3-913a-2b44bc61c46a tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Request method failure captured: Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 120 Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ8mKKAQv_WFaERzqF7f2ToojCCf3MSpj0c4RRbwtrGsX04uPsqkdMWhr6Tiljne-1uFJMCfiRwdJnzQSFuGnTUKwc1skdOtqwbwFkm6a01-9zrysfoYh0feuQ2qJhIPs78gp20lg9nezVAr2sQGbCA0m-fTtq_DjKh65xOIWWlImBI Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: 8e483c67faaf4b7e952919ce5174da35 Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:10:30.615797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:10:30.617552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_8e483c67faaf4b7e952919ce5174da35"}]}] Aug 29 19:10:30.617552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.617552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 8e483c67faaf4b7e952919ce5174da35 Aug 29 19:10:30.617552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.617552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-VolumesNegativeTest-182901272-project Aug 29 19:10:30.617552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:10:30.617552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:10:30.617552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: f61d3852c17d468dbbd897af74e7dd8f Aug 29 19:10:30.617552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-VolumesNegativeTest-182901272-project Aug 29 19:10:30.617552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Aug 29 19:10:30.617552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2088066717", "metadata": {"Type": "work"}}} Aug 29 19:10:30.617552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: Aug 29 19:10:30.617552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2088066717', 'metadata': {'Type': 'work'}}}} Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise error Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi '0' Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:10:30.618545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 19:10:30.620140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 19:10:30.621500 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 19:10:30.621500 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.621500 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-67c4624f-d065-47a3-913a-2b44bc61c46a tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:10:30.621500 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-67c4624f-d065-47a3-913a-2b44bc61c46a tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011379 Aug 29 19:10:30.621500 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 412/811] 10.222.0.86 () {60 vars in 1156 bytes} [Mon Aug 29 19:10:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:10:30.626747 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-03c5228e-35bd-4100-b608-8be994faf175 tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Action: 'create', calling method: .version_select at 0x7fb2bd5bb3a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1919717822", "metadata": {"Type": "work"}}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-03c5228e-35bd-4100-b608-8be994faf175 tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Request method failure captured: Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 119 Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ8mKKAQv_WFaERzqF7f2ToojCCf3MSpj0c4RRbwtrGsX04uPsqkdMWhr6Tiljne-1uFJMCfiRwdJnzQSFuGnTUKwc1skdOtqwbwFkm6a01-9zrysfoYh0feuQ2qJhIPs78gp20lg9nezVAr2sQGbCA0m-fTtq_DjKh65xOIWWlImBI Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 8e483c67faaf4b7e952919ce5174da35 Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:10:30.634949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:10:30.636610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_8e483c67faaf4b7e952919ce5174da35"}]}] Aug 29 19:10:30.636610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.636610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 8e483c67faaf4b7e952919ce5174da35 Aug 29 19:10:30.636610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.636610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesNegativeTest-182901272-project Aug 29 19:10:30.636610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:10:30.636610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:10:30.636610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: f61d3852c17d468dbbd897af74e7dd8f Aug 29 19:10:30.636610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesNegativeTest-182901272-project Aug 29 19:10:30.636610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Aug 29 19:10:30.636610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1919717822", "metadata": {"Type": "work"}}} Aug 29 19:10:30.636610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: Aug 29 19:10:30.636610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1919717822', 'metadata': {'Type': 'work'}}}} Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise error Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi '' Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:10:30.637544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 19:10:30.638863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 19:10:30.639996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 19:10:30.639996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.639996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-03c5228e-35bd-4100-b608-8be994faf175 tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:10:30.639996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-03c5228e-35bd-4100-b608-8be994faf175 tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013520 Aug 29 19:10:30.639996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 400/812] 10.222.0.86 () {60 vars in 1156 bytes} [Mon Aug 29 19:10:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:10:30.645834 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d99b19e5-2921-4eea-ac4d-91db63ef430d tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Calling method '.version_select at 0x7fb2b9cfcca0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:30.678376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-d99b19e5-2921-4eea-ac4d-91db63ef430d tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] HTTP exception thrown: Volume tempest-invalid-823459922 could not be found. Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d99b19e5-2921-4eea-ac4d-91db63ef430d tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Request method failure captured: Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-823459922 HTTP/1.1 Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ8mKKAQv_WFaERzqF7f2ToojCCf3MSpj0c4RRbwtrGsX04uPsqkdMWhr6Tiljne-1uFJMCfiRwdJnzQSFuGnTUKwc1skdOtqwbwFkm6a01-9zrysfoYh0feuQ2qJhIPs78gp20lg9nezVAr2sQGbCA0m-fTtq_DjKh65xOIWWlImBI Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: 8e483c67faaf4b7e952919ce5174da35 Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:10:30.682653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:10:30.684215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_8e483c67faaf4b7e952919ce5174da35"}]}] Aug 29 19:10:30.684215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.684215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 8e483c67faaf4b7e952919ce5174da35 Aug 29 19:10:30.684215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.684215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-VolumesNegativeTest-182901272-project Aug 29 19:10:30.684215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:10:30.684215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:10:30.684215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: f61d3852c17d468dbbd897af74e7dd8f Aug 29 19:10:30.684215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-VolumesNegativeTest-182901272-project Aug 29 19:10:30.684215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: Aug 29 19:10:30.684215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Volume tempest-invalid-823459922 could not be found. Aug 29 19:10:30.684215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': 'tempest-invalid-823459922'} Aug 29 19:10:30.684215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-823459922 could not be found. (HTTP 404) (Request-ID: req-8bdacf6d-234d-42ed-a591-c0aa4cf70405) Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:30.685114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:10:30.686276 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-823459922 could not be found. Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:10:30.687432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-823459922 could not be found. Aug 29 19:10:30.688605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.688605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:30.688605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.688605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.688605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:30.688605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:30.688605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:10:30.688605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:10:30.688605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-823459922 could not be found. Aug 29 19:10:30.688605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.688605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d99b19e5-2921-4eea-ac4d-91db63ef430d tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Returning 404 to user: Volume tempest-invalid-823459922 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:10:30.688605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d99b19e5-2921-4eea-ac4d-91db63ef430d tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/tempest-invalid-823459922" status: 404 len: 98 microversion: 2.1 time: 0.042186 Aug 29 19:10:30.688605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 413/813] 10.222.0.86 () {58 vars in 1215 bytes} [Mon Aug 29 19:10:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-823459922 => generated 98 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 19:10:30.694510 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-24f8a4c5-48e1-445d-bc49-c5631b1feb32 tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004310 Aug 29 19:10:30.695213 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 401/814] 10.222.0.86 () {58 vars in 1140 bytes} [Mon Aug 29 19:10:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 19:10:30.704277 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bf851890-edaf-43c8-b3f9-ad9af41688a4 tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003775 Aug 29 19:10:30.704779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 414/815] 10.222.0.86 () {58 vars in 1137 bytes} [Mon Aug 29 19:10:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 29 19:10:30.713887 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-936a1ac9-996a-4fa0-9061-06799efbe5bc tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Calling method '.version_select at 0x7fb2bd5cf310>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:30.755299 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-936a1ac9-996a-4fa0-9061-06799efbe5bc tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] HTTP exception thrown: Volume 60716c1a-5569-4671-a98e-dfb37c51b548 could not be found. Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-936a1ac9-996a-4fa0-9061-06799efbe5bc tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Request method failure captured: Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: DELETE /compute/v2.1/os-volumes/60716c1a-5569-4671-a98e-dfb37c51b548 HTTP/1.1 Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ8mKKAQv_WFaERzqF7f2ToojCCf3MSpj0c4RRbwtrGsX04uPsqkdMWhr6Tiljne-1uFJMCfiRwdJnzQSFuGnTUKwc1skdOtqwbwFkm6a01-9zrysfoYh0feuQ2qJhIPs78gp20lg9nezVAr2sQGbCA0m-fTtq_DjKh65xOIWWlImBI Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 8e483c67faaf4b7e952919ce5174da35 Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:10:30.758487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:10:30.760062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_8e483c67faaf4b7e952919ce5174da35"}]}] Aug 29 19:10:30.760062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.760062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 8e483c67faaf4b7e952919ce5174da35 Aug 29 19:10:30.760062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.760062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesNegativeTest-182901272-project Aug 29 19:10:30.760062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:10:30.760062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:10:30.760062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: f61d3852c17d468dbbd897af74e7dd8f Aug 29 19:10:30.760062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesNegativeTest-182901272-project Aug 29 19:10:30.760062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: Aug 29 19:10:30.760062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Volume 60716c1a-5569-4671-a98e-dfb37c51b548 could not be found. Aug 29 19:10:30.760062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': '60716c1a-5569-4671-a98e-dfb37c51b548'} Aug 29 19:10:30.760062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60716c1a-5569-4671-a98e-dfb37c51b548 could not be found. (HTTP 404) (Request-ID: req-fa76c81a-4a7e-4815-8cb0-eb0222ba3009) Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:30.760967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:10:30.762096 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60716c1a-5569-4671-a98e-dfb37c51b548 could not be found. Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 19:10:30.763318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:10:30.764519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60716c1a-5569-4671-a98e-dfb37c51b548 could not be found. Aug 29 19:10:30.764519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.764519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:30.764519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.764519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.764519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:30.764519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:30.764519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:10:30.764519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:10:30.764519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60716c1a-5569-4671-a98e-dfb37c51b548 could not be found. Aug 29 19:10:30.764519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.764519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-936a1ac9-996a-4fa0-9061-06799efbe5bc tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Returning 404 to user: Volume 60716c1a-5569-4671-a98e-dfb37c51b548 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:10:30.764519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-936a1ac9-996a-4fa0-9061-06799efbe5bc tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/60716c1a-5569-4671-a98e-dfb37c51b548" status: 404 len: 109 microversion: 2.1 time: 0.050942 Aug 29 19:10:30.764519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 402/816] 10.222.0.86 () {58 vars in 1248 bytes} [Mon Aug 29 19:10:30 2022] DELETE /compute/v2.1/os-volumes/60716c1a-5569-4671-a98e-dfb37c51b548 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:10:30.773353 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-715cb792-7a51-4258-bc9f-d951b7c5c87a tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Calling method '.version_select at 0x7fb2b9cc99d0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:30.802015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-715cb792-7a51-4258-bc9f-d951b7c5c87a tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] HTTP exception thrown: Volume 897ffde7-8748-4cca-8d9e-447fda05285f could not be found. Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-715cb792-7a51-4258-bc9f-d951b7c5c87a tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Request method failure captured: Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/os-volumes/897ffde7-8748-4cca-8d9e-447fda05285f HTTP/1.1 Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ8mKKAQv_WFaERzqF7f2ToojCCf3MSpj0c4RRbwtrGsX04uPsqkdMWhr6Tiljne-1uFJMCfiRwdJnzQSFuGnTUKwc1skdOtqwbwFkm6a01-9zrysfoYh0feuQ2qJhIPs78gp20lg9nezVAr2sQGbCA0m-fTtq_DjKh65xOIWWlImBI Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: 8e483c67faaf4b7e952919ce5174da35 Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:10:30.804503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:10:30.806067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/8e483c67faaf4b7e952919ce5174da35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_8e483c67faaf4b7e952919ce5174da35"}]}] Aug 29 19:10:30.806067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.806067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 8e483c67faaf4b7e952919ce5174da35 Aug 29 19:10:30.806067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-VolumesNegativeTest-182901272 Aug 29 19:10:30.806067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-VolumesNegativeTest-182901272-project Aug 29 19:10:30.806067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:10:30.806067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:10:30.806067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: f61d3852c17d468dbbd897af74e7dd8f Aug 29 19:10:30.806067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-VolumesNegativeTest-182901272-project Aug 29 19:10:30.806067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: Aug 29 19:10:30.806067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Volume 897ffde7-8748-4cca-8d9e-447fda05285f could not be found. Aug 29 19:10:30.806067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': '897ffde7-8748-4cca-8d9e-447fda05285f'} Aug 29 19:10:30.806067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 897ffde7-8748-4cca-8d9e-447fda05285f could not be found. (HTTP 404) (Request-ID: req-6ccfab3c-fbd7-4a69-a2c7-c1600fa8d596) Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:30.806910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:10:30.808168 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 897ffde7-8748-4cca-8d9e-447fda05285f could not be found. Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 19:10:30.809281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:10:30.810417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 897ffde7-8748-4cca-8d9e-447fda05285f could not be found. Aug 29 19:10:30.810417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.810417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:30.810417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.810417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:30.810417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:30.810417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:30.810417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:10:30.810417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:10:30.810417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 897ffde7-8748-4cca-8d9e-447fda05285f could not be found. Aug 29 19:10:30.810417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:10:30.810417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-715cb792-7a51-4258-bc9f-d951b7c5c87a tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] Returning 404 to user: Volume 897ffde7-8748-4cca-8d9e-447fda05285f could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:10:30.810417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-715cb792-7a51-4258-bc9f-d951b7c5c87a tempest-VolumesNegativeTest-182901272 tempest-VolumesNegativeTest-182901272-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/897ffde7-8748-4cca-8d9e-447fda05285f" status: 404 len: 109 microversion: 2.1 time: 0.036774 Aug 29 19:10:30.810417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 415/817] 10.222.0.86 () {58 vars in 1245 bytes} [Mon Aug 29 19:10:30 2022] GET /compute/v2.1/os-volumes/897ffde7-8748-4cca-8d9e-447fda05285f => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:11:26.469445 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-de2576ec-b8b0-47fb-ae07-97476d3a3939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:26.470707 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-de2576ec-b8b0-47fb-ae07-97476d3a3939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:26.476592 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:26.477381 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=42 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:26.485360 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-de2576ec-b8b0-47fb-ae07-97476d3a3939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:26.485776 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-de2576ec-b8b0-47fb-ae07-97476d3a3939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:26.487781 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-de2576ec-b8b0-47fb-ae07-97476d3a3939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:26.488598 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-de2576ec-b8b0-47fb-ae07-97476d3a3939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:26.491570 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-de2576ec-b8b0-47fb-ae07-97476d3a3939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:26.492015 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-de2576ec-b8b0-47fb-ae07-97476d3a3939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:26.517318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-de2576ec-b8b0-47fb-ae07-97476d3a3939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e/ips" status: 200 len: 150 microversion: 2.20 time: 0.051694 Aug 29 19:11:26.518410 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 403/818] 10.222.0.86 () {60 vars in 1289 bytes} [Mon Aug 29 19:11:26 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e/ips => generated 150 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:11:28.438232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:28.439154 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:28.446629 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b7ec85e7-8ce0-4aba-8630-fa227647ba01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:28.447504 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b7ec85e7-8ce0-4aba-8630-fa227647ba01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:28.463099 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7ec85e7-8ce0-4aba-8630-fa227647ba01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:28.463560 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7ec85e7-8ce0-4aba-8630-fa227647ba01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:28.464000 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7ec85e7-8ce0-4aba-8630-fa227647ba01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:28.464720 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7ec85e7-8ce0-4aba-8630-fa227647ba01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:28.465176 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7ec85e7-8ce0-4aba-8630-fa227647ba01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:28.465599 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7ec85e7-8ce0-4aba-8630-fa227647ba01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:28.494328 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-b7ec85e7-8ce0-4aba-8630-fa227647ba01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lazy-loading 'flavor' on Instance uuid 77353c2d-0418-48b1-a87a-2b6d8cc0f96e {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:11:28.721405 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b7ec85e7-8ce0-4aba-8630-fa227647ba01 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "POST /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e/action" status: 202 len: 0 microversion: 2.20 time: 0.284768 Aug 29 19:11:28.722581 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 416/819] 10.222.0.86 () {62 vars in 1319 bytes} [Mon Aug 29 19:11:28 2022] POST /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:11:28.731554 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3326f92e-22b4-4757-815a-697be7043fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:28.732789 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3326f92e-22b4-4757-815a-697be7043fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:28.740217 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3326f92e-22b4-4757-815a-697be7043fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:28.740981 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3326f92e-22b4-4757-815a-697be7043fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:28.741475 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3326f92e-22b4-4757-815a-697be7043fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:28.742388 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3326f92e-22b4-4757-815a-697be7043fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:28.742980 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3326f92e-22b4-4757-815a-697be7043fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:28.743555 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3326f92e-22b4-4757-815a-697be7043fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:28.894872 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3326f92e-22b4-4757-815a-697be7043fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:28.903493 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3326f92e-22b4-4757-815a-697be7043fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:28.904929 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3326f92e-22b4-4757-815a-697be7043fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:28.906104 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3326f92e-22b4-4757-815a-697be7043fd9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.179204 Aug 29 19:11:28.906651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 404/820] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:28 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:29.933697 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-985e0db2-5ef6-4f67-a550-b12273861e54 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:29.935214 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-985e0db2-5ef6-4f67-a550-b12273861e54 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:29.944661 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-985e0db2-5ef6-4f67-a550-b12273861e54 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:29.945307 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-985e0db2-5ef6-4f67-a550-b12273861e54 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:29.945892 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-985e0db2-5ef6-4f67-a550-b12273861e54 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:29.946732 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-985e0db2-5ef6-4f67-a550-b12273861e54 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:29.947320 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-985e0db2-5ef6-4f67-a550-b12273861e54 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:29.947868 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-985e0db2-5ef6-4f67-a550-b12273861e54 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:30.233943 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-985e0db2-5ef6-4f67-a550-b12273861e54 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:30.248223 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-985e0db2-5ef6-4f67-a550-b12273861e54 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:30.252648 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-985e0db2-5ef6-4f67-a550-b12273861e54 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:30.255408 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-985e0db2-5ef6-4f67-a550-b12273861e54 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.327787 Aug 29 19:11:30.256558 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 417/821] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:29 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:31.278483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ce6fe61a-bc82-4f6a-a449-887fe15ecdda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:31.280049 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ce6fe61a-bc82-4f6a-a449-887fe15ecdda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:31.292228 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ce6fe61a-bc82-4f6a-a449-887fe15ecdda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:31.293919 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ce6fe61a-bc82-4f6a-a449-887fe15ecdda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:31.294845 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ce6fe61a-bc82-4f6a-a449-887fe15ecdda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:31.295856 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ce6fe61a-bc82-4f6a-a449-887fe15ecdda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:31.296598 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ce6fe61a-bc82-4f6a-a449-887fe15ecdda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:31.297279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ce6fe61a-bc82-4f6a-a449-887fe15ecdda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:31.694779 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ce6fe61a-bc82-4f6a-a449-887fe15ecdda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:31.711459 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ce6fe61a-bc82-4f6a-a449-887fe15ecdda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:31.714091 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ce6fe61a-bc82-4f6a-a449-887fe15ecdda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:31.715362 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ce6fe61a-bc82-4f6a-a449-887fe15ecdda tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.440852 Aug 29 19:11:31.738933 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 405/822] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:31 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:11:32.749037 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1f365c6b-adbb-42d5-b35d-9894e8842689 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:32.750261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1f365c6b-adbb-42d5-b35d-9894e8842689 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:32.763393 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f365c6b-adbb-42d5-b35d-9894e8842689 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:32.763894 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f365c6b-adbb-42d5-b35d-9894e8842689 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:32.764331 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f365c6b-adbb-42d5-b35d-9894e8842689 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:32.765059 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f365c6b-adbb-42d5-b35d-9894e8842689 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:32.771583 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f365c6b-adbb-42d5-b35d-9894e8842689 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:32.774443 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f365c6b-adbb-42d5-b35d-9894e8842689 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:32.946378 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1f365c6b-adbb-42d5-b35d-9894e8842689 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:32.956125 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1f365c6b-adbb-42d5-b35d-9894e8842689 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:32.959181 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1f365c6b-adbb-42d5-b35d-9894e8842689 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:32.960593 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1f365c6b-adbb-42d5-b35d-9894e8842689 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.215731 Aug 29 19:11:32.976488 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 418/823] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:32 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:33.986063 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c1a49607-1787-406a-8a4a-1df0c40b53a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:33.986934 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c1a49607-1787-406a-8a4a-1df0c40b53a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:33.995997 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1a49607-1787-406a-8a4a-1df0c40b53a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:33.996462 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1a49607-1787-406a-8a4a-1df0c40b53a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:33.996917 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1a49607-1787-406a-8a4a-1df0c40b53a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:33.997540 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1a49607-1787-406a-8a4a-1df0c40b53a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:33.998182 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1a49607-1787-406a-8a4a-1df0c40b53a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:33.998775 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1a49607-1787-406a-8a4a-1df0c40b53a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:34.115911 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a08e3747-8c00-4699-b482-4b5c498973f3 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Action: 'create', calling method: .version_select at 0x7fb2b9e043a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2006349790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+yAuj6RIXZZaJHynkVE1Uz5++RpAn1yFDDH2OC1H3efxC+frlemmLYq8eV0iJpMyxLmCQZ0YuRSYcsE2+VGWoQe5aB4M5V0OM2t0YfRVpy7K4JrQUTHBO/AvoHlGM+Mw=="}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:34.134306 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-a08e3747-8c00-4699-b482-4b5c498973f3 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Getting quotas for project 3d7f020293da4a45a541d6ca1397380d. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:11:34.144210 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-a08e3747-8c00-4699-b482-4b5c498973f3 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Getting quotas for user 260ffd33f3c443c09fdb8d27a1de846e and project 3d7f020293da4a45a541d6ca1397380d. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:11:34.172282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a08e3747-8c00-4699-b482-4b5c498973f3 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.298595 Aug 29 19:11:34.174029 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 406/824] 10.222.0.86 () {60 vars in 1159 bytes} [Mon Aug 29 19:11:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:11:34.176179 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c1a49607-1787-406a-8a4a-1df0c40b53a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:34.186984 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c1a49607-1787-406a-8a4a-1df0c40b53a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:34.188583 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c1a49607-1787-406a-8a4a-1df0c40b53a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:34.189770 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c1a49607-1787-406a-8a4a-1df0c40b53a3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.208341 Aug 29 19:11:34.190334 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 419/825] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:33 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:11:35.215576 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-dc1e2cdf-bc35-45db-9d68-5506cf540313 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:35.216323 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-dc1e2cdf-bc35-45db-9d68-5506cf540313 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:35.222909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc1e2cdf-bc35-45db-9d68-5506cf540313 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:35.224035 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc1e2cdf-bc35-45db-9d68-5506cf540313 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:35.224463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc1e2cdf-bc35-45db-9d68-5506cf540313 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:35.225146 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc1e2cdf-bc35-45db-9d68-5506cf540313 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:35.225684 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc1e2cdf-bc35-45db-9d68-5506cf540313 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:35.226226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dc1e2cdf-bc35-45db-9d68-5506cf540313 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:35.360937 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-dc1e2cdf-bc35-45db-9d68-5506cf540313 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:35.369757 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-dc1e2cdf-bc35-45db-9d68-5506cf540313 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:35.371283 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-dc1e2cdf-bc35-45db-9d68-5506cf540313 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:35.372472 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-dc1e2cdf-bc35-45db-9d68-5506cf540313 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.161407 Aug 29 19:11:35.373006 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 407/826] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:35 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:36.396986 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5e5ee8f8-4d5d-4fe1-9ba8-0ea45a357f39 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:36.397627 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5e5ee8f8-4d5d-4fe1-9ba8-0ea45a357f39 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:36.404675 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e5ee8f8-4d5d-4fe1-9ba8-0ea45a357f39 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:36.405339 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e5ee8f8-4d5d-4fe1-9ba8-0ea45a357f39 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:36.405826 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e5ee8f8-4d5d-4fe1-9ba8-0ea45a357f39 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:36.406674 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e5ee8f8-4d5d-4fe1-9ba8-0ea45a357f39 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:36.407240 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e5ee8f8-4d5d-4fe1-9ba8-0ea45a357f39 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:36.407731 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e5ee8f8-4d5d-4fe1-9ba8-0ea45a357f39 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:36.547941 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5e5ee8f8-4d5d-4fe1-9ba8-0ea45a357f39 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:36.556579 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5e5ee8f8-4d5d-4fe1-9ba8-0ea45a357f39 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:36.558223 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5e5ee8f8-4d5d-4fe1-9ba8-0ea45a357f39 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:36.559889 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5e5ee8f8-4d5d-4fe1-9ba8-0ea45a357f39 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.168237 Aug 29 19:11:36.560708 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 420/827] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:36 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:11:37.583324 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fa804fb6-93eb-4643-9238-9082d0c5602d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:37.584767 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fa804fb6-93eb-4643-9238-9082d0c5602d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:37.591438 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa804fb6-93eb-4643-9238-9082d0c5602d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:37.591927 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa804fb6-93eb-4643-9238-9082d0c5602d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:37.592362 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa804fb6-93eb-4643-9238-9082d0c5602d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:37.593061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa804fb6-93eb-4643-9238-9082d0c5602d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:37.593517 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa804fb6-93eb-4643-9238-9082d0c5602d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:37.593943 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa804fb6-93eb-4643-9238-9082d0c5602d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:37.828069 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fa804fb6-93eb-4643-9238-9082d0c5602d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:37.841496 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fa804fb6-93eb-4643-9238-9082d0c5602d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:37.843521 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fa804fb6-93eb-4643-9238-9082d0c5602d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:37.847138 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fa804fb6-93eb-4643-9238-9082d0c5602d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.266078 Aug 29 19:11:37.847730 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 408/828] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:37 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:38.869801 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8fa6cde6-01b4-4b21-85de-1de7fdab0939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:38.870404 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8fa6cde6-01b4-4b21-85de-1de7fdab0939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:38.877293 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fa6cde6-01b4-4b21-85de-1de7fdab0939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:38.877779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fa6cde6-01b4-4b21-85de-1de7fdab0939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:38.878207 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fa6cde6-01b4-4b21-85de-1de7fdab0939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:38.878911 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fa6cde6-01b4-4b21-85de-1de7fdab0939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:38.879876 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fa6cde6-01b4-4b21-85de-1de7fdab0939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:38.880291 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fa6cde6-01b4-4b21-85de-1de7fdab0939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:39.125982 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8fa6cde6-01b4-4b21-85de-1de7fdab0939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:39.135371 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8fa6cde6-01b4-4b21-85de-1de7fdab0939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:39.136920 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8fa6cde6-01b4-4b21-85de-1de7fdab0939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:39.138175 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8fa6cde6-01b4-4b21-85de-1de7fdab0939 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.272333 Aug 29 19:11:39.139046 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 421/829] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:38 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:11:40.165278 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b8275ef5-64f7-4eeb-9e69-e6e5f8399464 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:40.165881 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b8275ef5-64f7-4eeb-9e69-e6e5f8399464 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:40.174019 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8275ef5-64f7-4eeb-9e69-e6e5f8399464 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:40.174503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8275ef5-64f7-4eeb-9e69-e6e5f8399464 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:40.175111 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8275ef5-64f7-4eeb-9e69-e6e5f8399464 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:40.175801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8275ef5-64f7-4eeb-9e69-e6e5f8399464 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:40.176327 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8275ef5-64f7-4eeb-9e69-e6e5f8399464 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:40.177253 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8275ef5-64f7-4eeb-9e69-e6e5f8399464 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:40.312803 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b8275ef5-64f7-4eeb-9e69-e6e5f8399464 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:40.322299 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b8275ef5-64f7-4eeb-9e69-e6e5f8399464 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:40.324279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b8275ef5-64f7-4eeb-9e69-e6e5f8399464 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:40.325596 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b8275ef5-64f7-4eeb-9e69-e6e5f8399464 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.165679 Aug 29 19:11:40.326367 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 409/830] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:40 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:41.349736 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2e624cd6-55c9-4ece-b1d0-70a75086455f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:41.350342 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2e624cd6-55c9-4ece-b1d0-70a75086455f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:41.357521 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e624cd6-55c9-4ece-b1d0-70a75086455f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:41.358023 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e624cd6-55c9-4ece-b1d0-70a75086455f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:41.358459 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e624cd6-55c9-4ece-b1d0-70a75086455f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:41.359445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e624cd6-55c9-4ece-b1d0-70a75086455f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:41.359903 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e624cd6-55c9-4ece-b1d0-70a75086455f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:41.360356 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e624cd6-55c9-4ece-b1d0-70a75086455f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:41.496783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2e624cd6-55c9-4ece-b1d0-70a75086455f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:41.506121 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2e624cd6-55c9-4ece-b1d0-70a75086455f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:41.507582 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2e624cd6-55c9-4ece-b1d0-70a75086455f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:41.508732 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2e624cd6-55c9-4ece-b1d0-70a75086455f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.163589 Aug 29 19:11:41.509278 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 422/831] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:41 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:42.536504 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0f4a32a5-1b59-459a-a4ce-36a3c6328b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:42.539418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0f4a32a5-1b59-459a-a4ce-36a3c6328b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:42.546387 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f4a32a5-1b59-459a-a4ce-36a3c6328b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:42.546884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f4a32a5-1b59-459a-a4ce-36a3c6328b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:42.548941 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f4a32a5-1b59-459a-a4ce-36a3c6328b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:42.549755 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f4a32a5-1b59-459a-a4ce-36a3c6328b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:42.550227 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f4a32a5-1b59-459a-a4ce-36a3c6328b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:42.550665 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f4a32a5-1b59-459a-a4ce-36a3c6328b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:42.685227 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0f4a32a5-1b59-459a-a4ce-36a3c6328b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:42.694892 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0f4a32a5-1b59-459a-a4ce-36a3c6328b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:42.696578 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0f4a32a5-1b59-459a-a4ce-36a3c6328b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:42.698113 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0f4a32a5-1b59-459a-a4ce-36a3c6328b99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.167714 Aug 29 19:11:42.699297 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 410/832] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:42 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:43.721869 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bea95c5e-78dc-44de-acb7-c8d168a98556 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:43.722505 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bea95c5e-78dc-44de-acb7-c8d168a98556 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:43.728940 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bea95c5e-78dc-44de-acb7-c8d168a98556 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:43.729422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bea95c5e-78dc-44de-acb7-c8d168a98556 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:43.729857 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bea95c5e-78dc-44de-acb7-c8d168a98556 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:43.730540 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bea95c5e-78dc-44de-acb7-c8d168a98556 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:43.731061 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bea95c5e-78dc-44de-acb7-c8d168a98556 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:43.731438 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bea95c5e-78dc-44de-acb7-c8d168a98556 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:43.862279 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bea95c5e-78dc-44de-acb7-c8d168a98556 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:43.870877 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bea95c5e-78dc-44de-acb7-c8d168a98556 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:43.872336 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bea95c5e-78dc-44de-acb7-c8d168a98556 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:43.873475 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bea95c5e-78dc-44de-acb7-c8d168a98556 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.155685 Aug 29 19:11:43.874026 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 423/833] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:43 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:44.896293 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c4293a13-415f-4a36-a2d7-e17dbc1f9e62 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:44.896913 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c4293a13-415f-4a36-a2d7-e17dbc1f9e62 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:44.899235 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=4 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:44.905119 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c4293a13-415f-4a36-a2d7-e17dbc1f9e62 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:44.905598 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c4293a13-415f-4a36-a2d7-e17dbc1f9e62 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:44.906251 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c4293a13-415f-4a36-a2d7-e17dbc1f9e62 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:44.907297 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c4293a13-415f-4a36-a2d7-e17dbc1f9e62 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:44.907691 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c4293a13-415f-4a36-a2d7-e17dbc1f9e62 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:44.907854 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c4293a13-415f-4a36-a2d7-e17dbc1f9e62 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:45.043617 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c4293a13-415f-4a36-a2d7-e17dbc1f9e62 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:45.051690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c4293a13-415f-4a36-a2d7-e17dbc1f9e62 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:45.053133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c4293a13-415f-4a36-a2d7-e17dbc1f9e62 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:45.054287 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c4293a13-415f-4a36-a2d7-e17dbc1f9e62 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.161993 Aug 29 19:11:45.054845 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 411/834] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:44 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:11:46.078461 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-eddd1ba4-a686-453d-bed9-a2d2888dc0ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:46.079121 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-eddd1ba4-a686-453d-bed9-a2d2888dc0ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:46.085630 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eddd1ba4-a686-453d-bed9-a2d2888dc0ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:46.086116 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eddd1ba4-a686-453d-bed9-a2d2888dc0ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:46.086552 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eddd1ba4-a686-453d-bed9-a2d2888dc0ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:46.087273 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eddd1ba4-a686-453d-bed9-a2d2888dc0ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:46.087729 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eddd1ba4-a686-453d-bed9-a2d2888dc0ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:46.088153 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eddd1ba4-a686-453d-bed9-a2d2888dc0ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:46.224899 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-eddd1ba4-a686-453d-bed9-a2d2888dc0ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:46.233629 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-eddd1ba4-a686-453d-bed9-a2d2888dc0ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:46.235029 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-eddd1ba4-a686-453d-bed9-a2d2888dc0ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:46.236290 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-eddd1ba4-a686-453d-bed9-a2d2888dc0ea tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.161780 Aug 29 19:11:46.236846 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 424/835] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:46 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:47.259167 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b35b8d32-5fb5-4918-8841-a647c36df814 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:47.259776 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b35b8d32-5fb5-4918-8841-a647c36df814 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:47.266211 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b35b8d32-5fb5-4918-8841-a647c36df814 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:47.266688 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b35b8d32-5fb5-4918-8841-a647c36df814 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:47.267160 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b35b8d32-5fb5-4918-8841-a647c36df814 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:47.267842 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b35b8d32-5fb5-4918-8841-a647c36df814 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:47.268300 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b35b8d32-5fb5-4918-8841-a647c36df814 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:47.268764 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b35b8d32-5fb5-4918-8841-a647c36df814 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:47.398920 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b35b8d32-5fb5-4918-8841-a647c36df814 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:47.407110 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b35b8d32-5fb5-4918-8841-a647c36df814 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:47.408529 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b35b8d32-5fb5-4918-8841-a647c36df814 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:47.409669 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b35b8d32-5fb5-4918-8841-a647c36df814 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1743 microversion: 2.20 time: 0.154484 Aug 29 19:11:47.410217 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 412/836] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:47 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:48.568690 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a5958975-aecc-415f-9c0b-20a6ca6a1271 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:48.569308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a5958975-aecc-415f-9c0b-20a6ca6a1271 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:48.575429 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5958975-aecc-415f-9c0b-20a6ca6a1271 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:48.575916 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5958975-aecc-415f-9c0b-20a6ca6a1271 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:48.576352 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5958975-aecc-415f-9c0b-20a6ca6a1271 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:48.577045 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5958975-aecc-415f-9c0b-20a6ca6a1271 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:48.577555 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5958975-aecc-415f-9c0b-20a6ca6a1271 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:48.577976 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5958975-aecc-415f-9c0b-20a6ca6a1271 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:48.718807 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a5958975-aecc-415f-9c0b-20a6ca6a1271 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:48.726982 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a5958975-aecc-415f-9c0b-20a6ca6a1271 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:48.728433 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a5958975-aecc-415f-9c0b-20a6ca6a1271 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:48.729577 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a5958975-aecc-415f-9c0b-20a6ca6a1271 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1743 microversion: 2.20 time: 0.300280 Aug 29 19:11:48.730130 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 425/837] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:48 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1743 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:49.753072 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-47da389d-f317-4aad-a50f-95e84450c337 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:49.753675 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-47da389d-f317-4aad-a50f-95e84450c337 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:49.760861 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47da389d-f317-4aad-a50f-95e84450c337 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:49.761604 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47da389d-f317-4aad-a50f-95e84450c337 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:49.762425 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47da389d-f317-4aad-a50f-95e84450c337 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:49.763540 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47da389d-f317-4aad-a50f-95e84450c337 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:49.763993 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47da389d-f317-4aad-a50f-95e84450c337 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:49.764410 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47da389d-f317-4aad-a50f-95e84450c337 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:49.896921 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-47da389d-f317-4aad-a50f-95e84450c337 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:49.904956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-47da389d-f317-4aad-a50f-95e84450c337 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:49.906384 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-47da389d-f317-4aad-a50f-95e84450c337 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:49.907591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-47da389d-f317-4aad-a50f-95e84450c337 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1743 microversion: 2.20 time: 0.158512 Aug 29 19:11:49.908148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 413/838] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:49 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:50.173754 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-e31e08da-69af-4a17-bda8-f5a39cfe83a8 req-f0abc92a-d054-462d-9cf3-4e25d3b65543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77353c2d-0418-48b1-a87a-2b6d8cc0f96e", "name": "network-vif-plugged", "status": "completed", "tag": "67ef5167-9ef6-4f02-967f-ca2f8ed4953a"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:50.184247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-e31e08da-69af-4a17-bda8-f5a39cfe83a8 req-f0abc92a-d054-462d-9cf3-4e25d3b65543 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:50.184734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-e31e08da-69af-4a17-bda8-f5a39cfe83a8 req-f0abc92a-d054-462d-9cf3-4e25d3b65543 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:50.185170 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-e31e08da-69af-4a17-bda8-f5a39cfe83a8 req-f0abc92a-d054-462d-9cf3-4e25d3b65543 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:50.197190 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-e31e08da-69af-4a17-bda8-f5a39cfe83a8 req-f0abc92a-d054-462d-9cf3-4e25d3b65543 service nova] Creating event network-vif-plugged:67ef5167-9ef6-4f02-967f-ca2f8ed4953a for instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e on hv-cinder-85083 Aug 29 19:11:50.202441 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-e31e08da-69af-4a17-bda8-f5a39cfe83a8 req-f0abc92a-d054-462d-9cf3-4e25d3b65543 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032621 Aug 29 19:11:50.203052 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 426/839] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:11:50.930259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9a70ad28-75f6-4739-afd8-8c4265d576bd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:50.930869 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9a70ad28-75f6-4739-afd8-8c4265d576bd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:50.937304 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9a70ad28-75f6-4739-afd8-8c4265d576bd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:50.937783 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9a70ad28-75f6-4739-afd8-8c4265d576bd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:50.938207 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9a70ad28-75f6-4739-afd8-8c4265d576bd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:50.938883 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9a70ad28-75f6-4739-afd8-8c4265d576bd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:50.939408 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9a70ad28-75f6-4739-afd8-8c4265d576bd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:50.939771 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9a70ad28-75f6-4739-afd8-8c4265d576bd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:51.071604 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9a70ad28-75f6-4739-afd8-8c4265d576bd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:51.079968 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9a70ad28-75f6-4739-afd8-8c4265d576bd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:51.081396 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9a70ad28-75f6-4739-afd8-8c4265d576bd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:51.082629 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9a70ad28-75f6-4739-afd8-8c4265d576bd tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1743 microversion: 2.20 time: 0.156815 Aug 29 19:11:51.083257 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 414/840] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:50 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:52.106309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-91e7546d-a537-4a35-9783-ee6891054969 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:52.107054 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-91e7546d-a537-4a35-9783-ee6891054969 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:52.113756 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91e7546d-a537-4a35-9783-ee6891054969 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:52.114904 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91e7546d-a537-4a35-9783-ee6891054969 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:52.115378 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91e7546d-a537-4a35-9783-ee6891054969 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:52.116080 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91e7546d-a537-4a35-9783-ee6891054969 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:52.116524 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91e7546d-a537-4a35-9783-ee6891054969 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:52.116942 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91e7546d-a537-4a35-9783-ee6891054969 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:52.255270 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-91e7546d-a537-4a35-9783-ee6891054969 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:52.263302 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-91e7546d-a537-4a35-9783-ee6891054969 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:52.264750 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-91e7546d-a537-4a35-9783-ee6891054969 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:52.265910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-91e7546d-a537-4a35-9783-ee6891054969 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1743 microversion: 2.20 time: 0.164360 Aug 29 19:11:52.266472 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 427/841] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:52 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:52.771972 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6225984f-251c-4583-b878-d5cd9223f3b5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:52.772519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6225984f-251c-4583-b878-d5cd9223f3b5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:52.778978 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6225984f-251c-4583-b878-d5cd9223f3b5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:52.779485 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6225984f-251c-4583-b878-d5cd9223f3b5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:52.779913 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6225984f-251c-4583-b878-d5cd9223f3b5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:52.780596 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6225984f-251c-4583-b878-d5cd9223f3b5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:52.781046 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6225984f-251c-4583-b878-d5cd9223f3b5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:52.781466 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6225984f-251c-4583-b878-d5cd9223f3b5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:52.806423 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6225984f-251c-4583-b878-d5cd9223f3b5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:11:52.882469 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6225984f-251c-4583-b878-d5cd9223f3b5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "DELETE /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 204 len: 0 microversion: 2.1 time: 0.114045 Aug 29 19:11:52.883112 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 415/842] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:11:52 2022] DELETE /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:11:52.891164 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-99245dbc-ed5e-4562-b4b9-e0ece65c8427 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:52.891775 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-99245dbc-ed5e-4562-b4b9-e0ece65c8427 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:52.899349 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99245dbc-ed5e-4562-b4b9-e0ece65c8427 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:52.899978 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99245dbc-ed5e-4562-b4b9-e0ece65c8427 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:52.900422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99245dbc-ed5e-4562-b4b9-e0ece65c8427 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:52.901125 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99245dbc-ed5e-4562-b4b9-e0ece65c8427 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:52.901583 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99245dbc-ed5e-4562-b4b9-e0ece65c8427 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:52.902009 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99245dbc-ed5e-4562-b4b9-e0ece65c8427 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:53.038826 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-99245dbc-ed5e-4562-b4b9-e0ece65c8427 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:53.046443 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-99245dbc-ed5e-4562-b4b9-e0ece65c8427 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1577 microversion: 2.1 time: 0.159272 Aug 29 19:11:53.047017 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 428/843] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:52 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:53.289763 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d7db7876-a4ed-448d-91d6-fe8b8e95b8ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:53.290365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d7db7876-a4ed-448d-91d6-fe8b8e95b8ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:53.296510 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d7db7876-a4ed-448d-91d6-fe8b8e95b8ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:53.297022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d7db7876-a4ed-448d-91d6-fe8b8e95b8ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:53.297457 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d7db7876-a4ed-448d-91d6-fe8b8e95b8ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:53.298148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d7db7876-a4ed-448d-91d6-fe8b8e95b8ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:53.298599 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d7db7876-a4ed-448d-91d6-fe8b8e95b8ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:53.299038 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d7db7876-a4ed-448d-91d6-fe8b8e95b8ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:53.430658 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d7db7876-a4ed-448d-91d6-fe8b8e95b8ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:53.438776 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d7db7876-a4ed-448d-91d6-fe8b8e95b8ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:53.440285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d7db7876-a4ed-448d-91d6-fe8b8e95b8ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:53.441448 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d7db7876-a4ed-448d-91d6-fe8b8e95b8ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1743 microversion: 2.20 time: 0.156680 Aug 29 19:11:53.442140 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 416/844] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:53 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:54.067799 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a9dae7bb-344f-4493-b63b-6ea575cbcf4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:54.068414 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a9dae7bb-344f-4493-b63b-6ea575cbcf4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:54.075106 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a9dae7bb-344f-4493-b63b-6ea575cbcf4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:54.075592 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a9dae7bb-344f-4493-b63b-6ea575cbcf4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:54.076032 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a9dae7bb-344f-4493-b63b-6ea575cbcf4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:54.076713 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a9dae7bb-344f-4493-b63b-6ea575cbcf4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:54.077166 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a9dae7bb-344f-4493-b63b-6ea575cbcf4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:54.077586 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a9dae7bb-344f-4493-b63b-6ea575cbcf4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:54.207969 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a9dae7bb-344f-4493-b63b-6ea575cbcf4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:54.215730 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a9dae7bb-344f-4493-b63b-6ea575cbcf4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1577 microversion: 2.1 time: 0.152335 Aug 29 19:11:54.216335 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 429/845] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:54 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:54.464600 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-929259d6-8084-41d2-8acb-e5a4012b7217 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:54.465116 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-929259d6-8084-41d2-8acb-e5a4012b7217 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:54.471731 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-929259d6-8084-41d2-8acb-e5a4012b7217 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:54.472213 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-929259d6-8084-41d2-8acb-e5a4012b7217 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:54.472648 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-929259d6-8084-41d2-8acb-e5a4012b7217 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:54.473334 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-929259d6-8084-41d2-8acb-e5a4012b7217 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:54.473791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-929259d6-8084-41d2-8acb-e5a4012b7217 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:54.474235 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-929259d6-8084-41d2-8acb-e5a4012b7217 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:54.606028 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-929259d6-8084-41d2-8acb-e5a4012b7217 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:54.614206 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-929259d6-8084-41d2-8acb-e5a4012b7217 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:54.615685 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-929259d6-8084-41d2-8acb-e5a4012b7217 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:54.616849 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-929259d6-8084-41d2-8acb-e5a4012b7217 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1743 microversion: 2.20 time: 0.156315 Aug 29 19:11:54.617516 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 417/846] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:54 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:55.236781 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a389a7d5-7c34-4570-932e-9935e23b0e5e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:55.237477 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a389a7d5-7c34-4570-932e-9935e23b0e5e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:55.244381 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a389a7d5-7c34-4570-932e-9935e23b0e5e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:55.244857 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a389a7d5-7c34-4570-932e-9935e23b0e5e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:55.245286 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a389a7d5-7c34-4570-932e-9935e23b0e5e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:55.245964 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a389a7d5-7c34-4570-932e-9935e23b0e5e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:55.246415 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a389a7d5-7c34-4570-932e-9935e23b0e5e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:55.246833 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a389a7d5-7c34-4570-932e-9935e23b0e5e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:55.373690 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a389a7d5-7c34-4570-932e-9935e23b0e5e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:55.381243 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a389a7d5-7c34-4570-932e-9935e23b0e5e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1577 microversion: 2.1 time: 0.148623 Aug 29 19:11:55.381800 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 430/847] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:55 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:55.639626 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4d848c40-74e8-4e47-b058-d313410281de tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:55.640235 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4d848c40-74e8-4e47-b058-d313410281de tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:55.647278 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d848c40-74e8-4e47-b058-d313410281de tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:55.647566 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d848c40-74e8-4e47-b058-d313410281de tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:55.648001 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d848c40-74e8-4e47-b058-d313410281de tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:55.648684 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d848c40-74e8-4e47-b058-d313410281de tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:55.649137 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d848c40-74e8-4e47-b058-d313410281de tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:55.649585 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d848c40-74e8-4e47-b058-d313410281de tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:55.779274 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4d848c40-74e8-4e47-b058-d313410281de tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:55.787912 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4d848c40-74e8-4e47-b058-d313410281de tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:55.789360 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4d848c40-74e8-4e47-b058-d313410281de tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:55.790503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4d848c40-74e8-4e47-b058-d313410281de tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1743 microversion: 2.20 time: 0.154699 Aug 29 19:11:55.791077 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 418/848] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:55 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:56.401800 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-45c8f7f6-0178-44f0-83a3-860ab399968e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:56.402348 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-45c8f7f6-0178-44f0-83a3-860ab399968e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:56.408898 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-45c8f7f6-0178-44f0-83a3-860ab399968e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:56.409386 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-45c8f7f6-0178-44f0-83a3-860ab399968e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:56.410054 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-45c8f7f6-0178-44f0-83a3-860ab399968e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:56.411190 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-45c8f7f6-0178-44f0-83a3-860ab399968e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:56.411653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-45c8f7f6-0178-44f0-83a3-860ab399968e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:56.412081 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-45c8f7f6-0178-44f0-83a3-860ab399968e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:56.416522 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:56.623320 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-45c8f7f6-0178-44f0-83a3-860ab399968e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:56.630990 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-45c8f7f6-0178-44f0-83a3-860ab399968e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1577 microversion: 2.1 time: 0.233179 Aug 29 19:11:56.631589 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 431/849] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:56 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1577 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:56.813342 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d9250a16-7f84-4723-adc5-8c2297a3ed74 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:56.813960 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d9250a16-7f84-4723-adc5-8c2297a3ed74 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:56.816509 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:56.821942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d9250a16-7f84-4723-adc5-8c2297a3ed74 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:56.822418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d9250a16-7f84-4723-adc5-8c2297a3ed74 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:56.822846 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d9250a16-7f84-4723-adc5-8c2297a3ed74 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:56.823557 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d9250a16-7f84-4723-adc5-8c2297a3ed74 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:56.824261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d9250a16-7f84-4723-adc5-8c2297a3ed74 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:56.824702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d9250a16-7f84-4723-adc5-8c2297a3ed74 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:56.829728 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:57.043967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d9250a16-7f84-4723-adc5-8c2297a3ed74 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:57.056992 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d9250a16-7f84-4723-adc5-8c2297a3ed74 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:57.058322 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d9250a16-7f84-4723-adc5-8c2297a3ed74 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:57.059692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d9250a16-7f84-4723-adc5-8c2297a3ed74 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1743 microversion: 2.20 time: 0.250247 Aug 29 19:11:57.063960 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 419/850] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:56 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:57.078108 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-a07efabc-0d00-4eab-8c3a-d2824148e6e6 req-cf1a0fd0-dd94-4672-8252-43038ac57743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee5a9c09-ea98-4feb-bbe7-f942b9ef1672", "name": "network-vif-deleted", "tag": "c815ca56-6391-4ced-92fa-9e28f650e18d"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:57.098592 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a07efabc-0d00-4eab-8c3a-d2824148e6e6 req-cf1a0fd0-dd94-4672-8252-43038ac57743 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:57.099099 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a07efabc-0d00-4eab-8c3a-d2824148e6e6 req-cf1a0fd0-dd94-4672-8252-43038ac57743 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:57.099815 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a07efabc-0d00-4eab-8c3a-d2824148e6e6 req-cf1a0fd0-dd94-4672-8252-43038ac57743 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:57.114745 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-a07efabc-0d00-4eab-8c3a-d2824148e6e6 req-cf1a0fd0-dd94-4672-8252-43038ac57743 service nova] Creating event network-vif-deleted:c815ca56-6391-4ced-92fa-9e28f650e18d for instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 on hv-cinder-85083 Aug 29 19:11:57.120955 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-a07efabc-0d00-4eab-8c3a-d2824148e6e6 req-cf1a0fd0-dd94-4672-8252-43038ac57743 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048737 Aug 29 19:11:57.121891 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 432/851] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:11:57.652173 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a92e3324-eb6b-4dcd-b2fc-15f7e28ec18a tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:57.652787 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a92e3324-eb6b-4dcd-b2fc-15f7e28ec18a tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:57.658716 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a92e3324-eb6b-4dcd-b2fc-15f7e28ec18a tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:57.659309 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a92e3324-eb6b-4dcd-b2fc-15f7e28ec18a tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:57.659744 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a92e3324-eb6b-4dcd-b2fc-15f7e28ec18a tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:57.660983 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a92e3324-eb6b-4dcd-b2fc-15f7e28ec18a tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:57.661468 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a92e3324-eb6b-4dcd-b2fc-15f7e28ec18a tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:57.661892 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a92e3324-eb6b-4dcd-b2fc-15f7e28ec18a tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:57.695443 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a92e3324-eb6b-4dcd-b2fc-15f7e28ec18a tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:57.695924 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a92e3324-eb6b-4dcd-b2fc-15f7e28ec18a tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:57.696358 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a92e3324-eb6b-4dcd-b2fc-15f7e28ec18a tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:57.696805 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-a92e3324-eb6b-4dcd-b2fc-15f7e28ec18a tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lazy-loading 'fault' on Instance uuid ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:11:57.742069 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a92e3324-eb6b-4dcd-b2fc-15f7e28ec18a tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:57.751583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a92e3324-eb6b-4dcd-b2fc-15f7e28ec18a tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 200 len: 1228 microversion: 2.1 time: 0.102881 Aug 29 19:11:57.752778 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 420/852] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:57 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 1228 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:58.084744 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ef5768f6-ccaa-4f30-bd3b-3b4405b7d142 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:58.085985 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ef5768f6-ccaa-4f30-bd3b-3b4405b7d142 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:58.092982 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef5768f6-ccaa-4f30-bd3b-3b4405b7d142 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:58.093777 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef5768f6-ccaa-4f30-bd3b-3b4405b7d142 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:58.094279 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef5768f6-ccaa-4f30-bd3b-3b4405b7d142 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:58.095091 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef5768f6-ccaa-4f30-bd3b-3b4405b7d142 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:58.095569 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef5768f6-ccaa-4f30-bd3b-3b4405b7d142 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:58.096854 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef5768f6-ccaa-4f30-bd3b-3b4405b7d142 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:58.236229 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ef5768f6-ccaa-4f30-bd3b-3b4405b7d142 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:58.244275 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ef5768f6-ccaa-4f30-bd3b-3b4405b7d142 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:58.245709 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ef5768f6-ccaa-4f30-bd3b-3b4405b7d142 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:58.246914 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ef5768f6-ccaa-4f30-bd3b-3b4405b7d142 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1738 microversion: 2.20 time: 0.166460 Aug 29 19:11:58.247451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 433/853] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:58 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:58.773723 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0728d0be-9ec6-49d1-8e38-ee6e2ea5cf3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:58.777924 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0728d0be-9ec6-49d1-8e38-ee6e2ea5cf3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:58.790133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0728d0be-9ec6-49d1-8e38-ee6e2ea5cf3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:58.790628 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0728d0be-9ec6-49d1-8e38-ee6e2ea5cf3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:58.791140 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0728d0be-9ec6-49d1-8e38-ee6e2ea5cf3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:58.791851 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0728d0be-9ec6-49d1-8e38-ee6e2ea5cf3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:58.792310 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0728d0be-9ec6-49d1-8e38-ee6e2ea5cf3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:58.792935 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0728d0be-9ec6-49d1-8e38-ee6e2ea5cf3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:58.814137 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-0728d0be-9ec6-49d1-8e38-ee6e2ea5cf3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] HTTP exception thrown: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0728d0be-9ec6-49d1-8e38-ee6e2ea5cf3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Request method failure captured: Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 HTTP/1.1 Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ6xIOHbuCod7G0gYnu-EDseizVg4zjtymjFllgWFW5QRp6-QFAnP-bRSJFl6NwK5qiiQFCorJU9A3OFmZuQOEY9QR_dH_budOBuvkZ10npfNWlzoc1qIPC2ygwRqFs-R9arfgyRyrDR7WL_DpirZZST3ouzsRrzSI3iVHw36crLDcA Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 5d70fdff5c5a443b9f0ae1a24dfffcd3 Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-TestVolumeBootPattern-456131431 Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:11:58.815793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:11:58.818139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}] Aug 29 19:11:58.818139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-TestVolumeBootPattern-456131431 Aug 29 19:11:58.818139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 5d70fdff5c5a443b9f0ae1a24dfffcd3 Aug 29 19:11:58.818139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-TestVolumeBootPattern-456131431 Aug 29 19:11:58.818139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-TestVolumeBootPattern-456131431-project Aug 29 19:11:58.818139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:11:58.818139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:11:58.818139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: 0547f15d00f043b99de10f3db7348c62 Aug 29 19:11:58.818139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-TestVolumeBootPattern-456131431-project Aug 29 19:11:58.818139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:11:58.818139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. Aug 29 19:11:58.818139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': 'ee5a9c09-ea98-4feb-bbe7-f942b9ef1672'} Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:11:58.819511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. Aug 29 19:11:58.821791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:11:58.824118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0728d0be-9ec6-49d1-8e38-ee6e2ea5cf3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Returning 404 to user: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:11:58.824118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0728d0be-9ec6-49d1-8e38-ee6e2ea5cf3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 404 len: 111 microversion: 2.1 time: 0.048126 Aug 29 19:11:58.824118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 421/854] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:58 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:11:58.956784 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1292150673", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-950876423", "security_groups": [{"name": "tempest-secgroup-smoke-1075310592"}], "block_device_mapping_v2": [{"uuid": "205f8f64-875b-4062-9f52-101d6b62f662", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "230bc59f-c520-4141-9d7a-a6fcb67f0194"}]}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:58.970600 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=37 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:59.110403 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] validate_networks() for [('230bc59f-c520-4141-9d7a-a6fcb67f0194', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:11:59.272684 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-61b99827-cf2a-4ad0-ab0a-e3bc232bcae7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:59.274212 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-61b99827-cf2a-4ad0-ab0a-e3bc232bcae7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:59.280382 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61b99827-cf2a-4ad0-ab0a-e3bc232bcae7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:59.280856 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61b99827-cf2a-4ad0-ab0a-e3bc232bcae7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:59.281284 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61b99827-cf2a-4ad0-ab0a-e3bc232bcae7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:59.282042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61b99827-cf2a-4ad0-ab0a-e3bc232bcae7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:59.282521 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61b99827-cf2a-4ad0-ab0a-e3bc232bcae7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:59.282937 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61b99827-cf2a-4ad0-ab0a-e3bc232bcae7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:59.560091 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-61b99827-cf2a-4ad0-ab0a-e3bc232bcae7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:59.574545 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-61b99827-cf2a-4ad0-ab0a-e3bc232bcae7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:59.581149 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-61b99827-cf2a-4ad0-ab0a-e3bc232bcae7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:59.585931 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-61b99827-cf2a-4ad0-ab0a-e3bc232bcae7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1738 microversion: 2.20 time: 0.315705 Aug 29 19:11:59.597682 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 422/855] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:59 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:11:59.610147 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:11:59.610567 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:11:59.611067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:11:59.611475 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:11:59.611884 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:11:59.620585 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:59.621066 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:59.621496 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:59.622216 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:59.622663 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:59.623109 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:59.639901 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Getting quotas for project 5d70fdff5c5a443b9f0ae1a24dfffcd3. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:11:59.643809 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Getting quotas for user 0547f15d00f043b99de10f3db7348c62 and project 5d70fdff5c5a443b9f0ae1a24dfffcd3. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:11:59.704069 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:11:59.706225 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='205f8f64-875b-4062-9f52-101d6b62f662',volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:11:59.841249 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6cb2ff95-787b-43b3-b5c8-a0329866ce01 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.890482 Aug 29 19:11:59.841872 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 434/856] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:11:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:11:59.852789 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-465ac3e0-9ac0-4a0a-995b-510a57f64b06 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:59.853406 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-465ac3e0-9ac0-4a0a-995b-510a57f64b06 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:59.914756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-465ac3e0-9ac0-4a0a-995b-510a57f64b06 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:59.938583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-465ac3e0-9ac0-4a0a-995b-510a57f64b06 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1094 microversion: 2.1 time: 0.089385 Aug 29 19:11:59.941192 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 423/857] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:59 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1094 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:00.609771 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-aedd6710-e556-401c-8963-82eb29fa42b5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:00.610361 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-aedd6710-e556-401c-8963-82eb29fa42b5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:00.617669 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aedd6710-e556-401c-8963-82eb29fa42b5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:00.618553 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aedd6710-e556-401c-8963-82eb29fa42b5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:00.619097 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aedd6710-e556-401c-8963-82eb29fa42b5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:00.620078 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aedd6710-e556-401c-8963-82eb29fa42b5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:00.620596 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aedd6710-e556-401c-8963-82eb29fa42b5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:00.621230 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aedd6710-e556-401c-8963-82eb29fa42b5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:00.759210 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-aedd6710-e556-401c-8963-82eb29fa42b5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:00.771771 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-aedd6710-e556-401c-8963-82eb29fa42b5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:00.773129 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-aedd6710-e556-401c-8963-82eb29fa42b5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:00.774954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-aedd6710-e556-401c-8963-82eb29fa42b5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1738 microversion: 2.20 time: 0.169723 Aug 29 19:12:00.775613 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 435/858] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:00 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:00.962863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2a5b4b22-b7b3-4236-8b77-49b43eecbd89 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:00.963351 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2a5b4b22-b7b3-4236-8b77-49b43eecbd89 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:00.973489 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a5b4b22-b7b3-4236-8b77-49b43eecbd89 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:00.974425 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a5b4b22-b7b3-4236-8b77-49b43eecbd89 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:00.975246 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a5b4b22-b7b3-4236-8b77-49b43eecbd89 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:00.976757 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a5b4b22-b7b3-4236-8b77-49b43eecbd89 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:00.977827 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a5b4b22-b7b3-4236-8b77-49b43eecbd89 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:00.978443 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a5b4b22-b7b3-4236-8b77-49b43eecbd89 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:01.041488 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 19:12:01.041953 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Mon Aug 29 19:12:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c (ip 10.222.0.86) !!! Aug 29 19:12:01.062001 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2a5b4b22-b7b3-4236-8b77-49b43eecbd89 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:01.072320 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2a5b4b22-b7b3-4236-8b77-49b43eecbd89 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1192 microversion: 2.1 time: 0.113569 Aug 29 19:12:01.073262 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 424/859] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:00 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1192 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:01.800072 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-93866944-1c10-40f0-8dc4-46c33c45cbd3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:01.801436 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-93866944-1c10-40f0-8dc4-46c33c45cbd3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:01.813098 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93866944-1c10-40f0-8dc4-46c33c45cbd3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:01.815397 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93866944-1c10-40f0-8dc4-46c33c45cbd3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:01.816056 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93866944-1c10-40f0-8dc4-46c33c45cbd3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:01.819066 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93866944-1c10-40f0-8dc4-46c33c45cbd3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:01.824939 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93866944-1c10-40f0-8dc4-46c33c45cbd3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:01.827332 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93866944-1c10-40f0-8dc4-46c33c45cbd3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:02.094436 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-378498e8-29a9-4ad6-9ee7-dfda41cf5157 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:02.095071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-378498e8-29a9-4ad6-9ee7-dfda41cf5157 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:02.106574 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-378498e8-29a9-4ad6-9ee7-dfda41cf5157 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:02.107109 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-378498e8-29a9-4ad6-9ee7-dfda41cf5157 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:02.107751 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-378498e8-29a9-4ad6-9ee7-dfda41cf5157 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:02.109380 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-378498e8-29a9-4ad6-9ee7-dfda41cf5157 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:02.119391 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-378498e8-29a9-4ad6-9ee7-dfda41cf5157 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:02.120190 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-378498e8-29a9-4ad6-9ee7-dfda41cf5157 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:02.304714 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-378498e8-29a9-4ad6-9ee7-dfda41cf5157 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:02.313178 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-378498e8-29a9-4ad6-9ee7-dfda41cf5157 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1210 microversion: 2.1 time: 0.222435 Aug 29 19:12:02.327370 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 425/860] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:02 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1210 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:02.430240 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-93866944-1c10-40f0-8dc4-46c33c45cbd3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:02.445825 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-93866944-1c10-40f0-8dc4-46c33c45cbd3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:02.447657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-93866944-1c10-40f0-8dc4-46c33c45cbd3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:02.449354 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-93866944-1c10-40f0-8dc4-46c33c45cbd3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1738 microversion: 2.20 time: 0.653414 Aug 29 19:12:02.463516 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 436/861] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:01 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1738 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:03.165354 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-1d23d552-f7d2-4585-a73a-b80e4552fc43 req-ce7233db-b05e-4794-a4f1-56c816f54879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b03fc5b-3bcc-4a6a-af76-aec661abea8c", "tag": "59b795aa-8009-4683-ad8c-ae35ee12bb84"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:03.179242 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-1d23d552-f7d2-4585-a73a-b80e4552fc43 req-ce7233db-b05e-4794-a4f1-56c816f54879 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:03.180161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-1d23d552-f7d2-4585-a73a-b80e4552fc43 req-ce7233db-b05e-4794-a4f1-56c816f54879 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:03.180900 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-1d23d552-f7d2-4585-a73a-b80e4552fc43 req-ce7233db-b05e-4794-a4f1-56c816f54879 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:03.210137 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-1d23d552-f7d2-4585-a73a-b80e4552fc43 req-ce7233db-b05e-4794-a4f1-56c816f54879 service nova] Creating event network-changed:59b795aa-8009-4683-ad8c-ae35ee12bb84 for instance 1b03fc5b-3bcc-4a6a-af76-aec661abea8c on hv-cinder-85083 Aug 29 19:12:03.216241 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-1d23d552-f7d2-4585-a73a-b80e4552fc43 req-ce7233db-b05e-4794-a4f1-56c816f54879 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055448 Aug 29 19:12:03.217488 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 426/862] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:03.339612 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8d9ea468-1aac-4862-9f9f-684b600aac99 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:03.340466 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8d9ea468-1aac-4862-9f9f-684b600aac99 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:03.350733 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d9ea468-1aac-4862-9f9f-684b600aac99 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:03.351257 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d9ea468-1aac-4862-9f9f-684b600aac99 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:03.352163 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d9ea468-1aac-4862-9f9f-684b600aac99 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:03.355405 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d9ea468-1aac-4862-9f9f-684b600aac99 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:03.356775 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d9ea468-1aac-4862-9f9f-684b600aac99 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:03.359331 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d9ea468-1aac-4862-9f9f-684b600aac99 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:03.484012 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0ddcb91a-750b-4870-848d-6b8f99529ca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:03.485293 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0ddcb91a-750b-4870-848d-6b8f99529ca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:03.498496 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ddcb91a-750b-4870-848d-6b8f99529ca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:03.499318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ddcb91a-750b-4870-848d-6b8f99529ca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:03.500147 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ddcb91a-750b-4870-848d-6b8f99529ca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:03.501364 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ddcb91a-750b-4870-848d-6b8f99529ca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:03.502441 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ddcb91a-750b-4870-848d-6b8f99529ca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:03.503235 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ddcb91a-750b-4870-848d-6b8f99529ca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:03.672638 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8d9ea468-1aac-4862-9f9f-684b600aac99 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:03.681667 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8d9ea468-1aac-4862-9f9f-684b600aac99 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1266 microversion: 2.1 time: 0.347975 Aug 29 19:12:03.683162 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 437/863] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:03 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1266 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:03.773805 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0ddcb91a-750b-4870-848d-6b8f99529ca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:03.784092 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0ddcb91a-750b-4870-848d-6b8f99529ca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:03.785885 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0ddcb91a-750b-4870-848d-6b8f99529ca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:03.787268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0ddcb91a-750b-4870-848d-6b8f99529ca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1738 microversion: 2.20 time: 0.311406 Aug 29 19:12:03.788279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 427/864] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:03 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1738 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:04.260116 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-234833434", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2006349790", "security_groups": [{"name": "tempest-secgroup-smoke-58673484"}], "networks": [{"uuid": "0857f720-3b88-42a4-9ea2-9bea9fc14be6"}], "block_device_mapping_v2": [{"uuid": "0f5d26f7-f98c-49ad-a5c8-957118ccef41", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:04.397314 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] validate_networks() for [('0857f720-3b88-42a4-9ea2-9bea9fc14be6', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:12:04.706081 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-320e90d4-df32-4c8b-af0b-537357995c05 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:04.707842 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-320e90d4-df32-4c8b-af0b-537357995c05 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:04.715304 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-320e90d4-df32-4c8b-af0b-537357995c05 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:04.716351 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-320e90d4-df32-4c8b-af0b-537357995c05 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:04.716983 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-320e90d4-df32-4c8b-af0b-537357995c05 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:04.718151 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-320e90d4-df32-4c8b-af0b-537357995c05 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:04.718771 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-320e90d4-df32-4c8b-af0b-537357995c05 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:04.719453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-320e90d4-df32-4c8b-af0b-537357995c05 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:04.869465 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:12:04.869894 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:12:04.870372 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:12:04.870802 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:12:04.871284 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:12:04.882848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:04.883502 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:04.883986 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:04.885308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:04.885635 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:04.886111 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:04.926801 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Getting quotas for project 3d7f020293da4a45a541d6ca1397380d. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:12:04.931440 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Getting quotas for user 260ffd33f3c443c09fdb8d27a1de846e and project 3d7f020293da4a45a541d6ca1397380d. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:12:04.933133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-320e90d4-df32-4c8b-af0b-537357995c05 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:04.944736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-320e90d4-df32-4c8b-af0b-537357995c05 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1266 microversion: 2.1 time: 0.243214 Aug 29 19:12:04.959065 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 428/865] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:04 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:04.964619 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a47e1905-a488-4687-8a6d-2d711495fca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:04.965412 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a47e1905-a488-4687-8a6d-2d711495fca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:04.972970 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a47e1905-a488-4687-8a6d-2d711495fca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:04.973677 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a47e1905-a488-4687-8a6d-2d711495fca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:04.974112 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a47e1905-a488-4687-8a6d-2d711495fca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:04.976288 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a47e1905-a488-4687-8a6d-2d711495fca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:04.976769 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a47e1905-a488-4687-8a6d-2d711495fca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:04.977210 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a47e1905-a488-4687-8a6d-2d711495fca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:05.025911 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:12:05.028113 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f5d26f7-f98c-49ad-a5c8-957118ccef41',volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:12:05.195433 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-32765c82-f078-4a2e-aa70-f2201cf3b1db tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.938793 Aug 29 19:12:05.196685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 438/866] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:12:04 2022] POST /compute/v2.1/servers => generated 404 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:12:05.210538 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-eb483ee2-3174-4d18-9c2d-a3c3ee914e27 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:05.212487 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-eb483ee2-3174-4d18-9c2d-a3c3ee914e27 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:05.232223 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a47e1905-a488-4687-8a6d-2d711495fca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:05.245494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a47e1905-a488-4687-8a6d-2d711495fca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:05.248766 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a47e1905-a488-4687-8a6d-2d711495fca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:05.250477 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a47e1905-a488-4687-8a6d-2d711495fca7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1738 microversion: 2.20 time: 0.290171 Aug 29 19:12:05.253207 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 429/867] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:04 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:05.324723 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-eb483ee2-3174-4d18-9c2d-a3c3ee914e27 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:05.332526 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-eb483ee2-3174-4d18-9c2d-a3c3ee914e27 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1088 microversion: 2.1 time: 0.126292 Aug 29 19:12:05.342660 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 439/868] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:05 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1088 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:05.965910 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-24e00433-c2df-4719-a966-642c4c69d9a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:05.967771 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-24e00433-c2df-4719-a966-642c4c69d9a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:05.978399 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-24e00433-c2df-4719-a966-642c4c69d9a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:05.979208 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-24e00433-c2df-4719-a966-642c4c69d9a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:05.979794 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-24e00433-c2df-4719-a966-642c4c69d9a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:05.980693 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-24e00433-c2df-4719-a966-642c4c69d9a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:05.981139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-24e00433-c2df-4719-a966-642c4c69d9a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:05.981728 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-24e00433-c2df-4719-a966-642c4c69d9a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:06.145718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-24e00433-c2df-4719-a966-642c4c69d9a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:06.154241 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-24e00433-c2df-4719-a966-642c4c69d9a6 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1266 microversion: 2.1 time: 0.192266 Aug 29 19:12:06.155235 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 430/869] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:05 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:06.280478 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-119943fd-6eaa-4794-986d-f1252ff4e9ca tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:06.281514 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-119943fd-6eaa-4794-986d-f1252ff4e9ca tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:06.287857 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-119943fd-6eaa-4794-986d-f1252ff4e9ca tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:06.288379 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-119943fd-6eaa-4794-986d-f1252ff4e9ca tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:06.288841 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-119943fd-6eaa-4794-986d-f1252ff4e9ca tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:06.289531 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-119943fd-6eaa-4794-986d-f1252ff4e9ca tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:06.289981 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-119943fd-6eaa-4794-986d-f1252ff4e9ca tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:06.290401 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-119943fd-6eaa-4794-986d-f1252ff4e9ca tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:06.354137 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-46e853f7-87ed-4873-85f8-f6ef8b9e5ae8 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:06.355264 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-46e853f7-87ed-4873-85f8-f6ef8b9e5ae8 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:06.362350 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-46e853f7-87ed-4873-85f8-f6ef8b9e5ae8 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:06.363074 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-46e853f7-87ed-4873-85f8-f6ef8b9e5ae8 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:06.364473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-46e853f7-87ed-4873-85f8-f6ef8b9e5ae8 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:06.365218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-46e853f7-87ed-4873-85f8-f6ef8b9e5ae8 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:06.365682 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-46e853f7-87ed-4873-85f8-f6ef8b9e5ae8 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:06.366109 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-46e853f7-87ed-4873-85f8-f6ef8b9e5ae8 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:06.448126 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-46e853f7-87ed-4873-85f8-f6ef8b9e5ae8 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:06.456553 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-46e853f7-87ed-4873-85f8-f6ef8b9e5ae8 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1186 microversion: 2.1 time: 0.106679 Aug 29 19:12:06.457810 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 431/870] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:06 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1186 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:06.488211 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-119943fd-6eaa-4794-986d-f1252ff4e9ca tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:06.498435 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-119943fd-6eaa-4794-986d-f1252ff4e9ca tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:06.500140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-119943fd-6eaa-4794-986d-f1252ff4e9ca tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:06.501427 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-119943fd-6eaa-4794-986d-f1252ff4e9ca tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1738 microversion: 2.20 time: 0.228914 Aug 29 19:12:06.502011 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 440/871] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:06 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:12:07.176894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-02c8b84f-581f-4f4e-93e4-4eb2332fd539 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:07.183926 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-02c8b84f-581f-4f4e-93e4-4eb2332fd539 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:07.191510 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-02c8b84f-581f-4f4e-93e4-4eb2332fd539 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:07.195757 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-02c8b84f-581f-4f4e-93e4-4eb2332fd539 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:07.196419 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-02c8b84f-581f-4f4e-93e4-4eb2332fd539 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:07.204145 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-02c8b84f-581f-4f4e-93e4-4eb2332fd539 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:07.204545 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-02c8b84f-581f-4f4e-93e4-4eb2332fd539 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:07.205630 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-02c8b84f-581f-4f4e-93e4-4eb2332fd539 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:07.478820 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4f549e1b-8e3e-4ecb-8ade-03ac5f383a26 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:07.479936 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4f549e1b-8e3e-4ecb-8ade-03ac5f383a26 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:07.490160 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f549e1b-8e3e-4ecb-8ade-03ac5f383a26 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:07.493532 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f549e1b-8e3e-4ecb-8ade-03ac5f383a26 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:07.494203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f549e1b-8e3e-4ecb-8ade-03ac5f383a26 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:07.497029 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f549e1b-8e3e-4ecb-8ade-03ac5f383a26 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:07.497560 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f549e1b-8e3e-4ecb-8ade-03ac5f383a26 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:07.498024 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f549e1b-8e3e-4ecb-8ade-03ac5f383a26 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:07.605424 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-02c8b84f-581f-4f4e-93e4-4eb2332fd539 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:07.617949 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4f549e1b-8e3e-4ecb-8ade-03ac5f383a26 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:07.629055 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-02c8b84f-581f-4f4e-93e4-4eb2332fd539 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1266 microversion: 2.1 time: 0.454523 Aug 29 19:12:07.647067 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4f549e1b-8e3e-4ecb-8ade-03ac5f383a26 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1204 microversion: 2.1 time: 0.172845 Aug 29 19:12:07.647591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 432/872] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:07 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1266 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:07.663991 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 441/873] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:07 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1204 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:07.671284 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-73ed7b42-afa6-4eb9-95fd-7b7cbd0a0057 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:07.671986 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-73ed7b42-afa6-4eb9-95fd-7b7cbd0a0057 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:07.681503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73ed7b42-afa6-4eb9-95fd-7b7cbd0a0057 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:07.682004 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73ed7b42-afa6-4eb9-95fd-7b7cbd0a0057 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:07.682644 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73ed7b42-afa6-4eb9-95fd-7b7cbd0a0057 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:07.683381 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73ed7b42-afa6-4eb9-95fd-7b7cbd0a0057 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:07.683827 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73ed7b42-afa6-4eb9-95fd-7b7cbd0a0057 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:07.684528 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73ed7b42-afa6-4eb9-95fd-7b7cbd0a0057 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:07.960234 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-73ed7b42-afa6-4eb9-95fd-7b7cbd0a0057 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:07.968611 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-73ed7b42-afa6-4eb9-95fd-7b7cbd0a0057 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:07.970127 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-73ed7b42-afa6-4eb9-95fd-7b7cbd0a0057 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:07.971329 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-73ed7b42-afa6-4eb9-95fd-7b7cbd0a0057 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1738 microversion: 2.20 time: 0.322414 Aug 29 19:12:07.972056 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 433/874] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:07 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1738 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:08.652478 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-53acb6ab-e666-4d9a-874f-37ffe6f224c5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:08.653124 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-53acb6ab-e666-4d9a-874f-37ffe6f224c5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:08.655199 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-efbc8959-6cfd-41dd-b356-3f89a3dcc896 req-f23c4e70-286a-4019-bf2b-70a91c814b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd46fd90-e3ac-4556-927a-14ce6c51239e", "tag": "7b17bd15-64ac-45c7-b33b-22f23076cf55"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:08.662174 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53acb6ab-e666-4d9a-874f-37ffe6f224c5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:08.662672 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53acb6ab-e666-4d9a-874f-37ffe6f224c5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:08.665274 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53acb6ab-e666-4d9a-874f-37ffe6f224c5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:08.666035 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53acb6ab-e666-4d9a-874f-37ffe6f224c5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:08.666511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53acb6ab-e666-4d9a-874f-37ffe6f224c5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:08.666938 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-53acb6ab-e666-4d9a-874f-37ffe6f224c5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:08.669883 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-efbc8959-6cfd-41dd-b356-3f89a3dcc896 req-f23c4e70-286a-4019-bf2b-70a91c814b5e service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:08.670596 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-efbc8959-6cfd-41dd-b356-3f89a3dcc896 req-f23c4e70-286a-4019-bf2b-70a91c814b5e service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:08.671237 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-efbc8959-6cfd-41dd-b356-3f89a3dcc896 req-f23c4e70-286a-4019-bf2b-70a91c814b5e service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:08.696424 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-efbc8959-6cfd-41dd-b356-3f89a3dcc896 req-f23c4e70-286a-4019-bf2b-70a91c814b5e service nova] Creating event network-changed:7b17bd15-64ac-45c7-b33b-22f23076cf55 for instance dd46fd90-e3ac-4556-927a-14ce6c51239e on hv-cinder-85083 Aug 29 19:12:08.702774 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-efbc8959-6cfd-41dd-b356-3f89a3dcc896 req-f23c4e70-286a-4019-bf2b-70a91c814b5e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055888 Aug 29 19:12:08.703800 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 442/875] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:08.709350 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8870b907-abef-46da-9c3a-9916c3cc4d1d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:08.710286 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8870b907-abef-46da-9c3a-9916c3cc4d1d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:08.717272 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8870b907-abef-46da-9c3a-9916c3cc4d1d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:08.718172 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8870b907-abef-46da-9c3a-9916c3cc4d1d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:08.719105 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8870b907-abef-46da-9c3a-9916c3cc4d1d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:08.719967 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8870b907-abef-46da-9c3a-9916c3cc4d1d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:08.720600 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8870b907-abef-46da-9c3a-9916c3cc4d1d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:08.721591 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8870b907-abef-46da-9c3a-9916c3cc4d1d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:09.077762 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-53acb6ab-e666-4d9a-874f-37ffe6f224c5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:09.087329 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8870b907-abef-46da-9c3a-9916c3cc4d1d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:09.098677 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8870b907-abef-46da-9c3a-9916c3cc4d1d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.393374 Aug 29 19:12:09.099226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 443/876] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:08 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:09.112538 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-53acb6ab-e666-4d9a-874f-37ffe6f224c5 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1266 microversion: 2.1 time: 0.464061 Aug 29 19:12:09.116244 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 434/877] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:08 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1266 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:09.133768 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9dc1f99e-892c-4f86-b4d4-c662cf505107 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:09.134272 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9dc1f99e-892c-4f86-b4d4-c662cf505107 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:09.140425 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9dc1f99e-892c-4f86-b4d4-c662cf505107 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:09.140918 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9dc1f99e-892c-4f86-b4d4-c662cf505107 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:09.141360 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9dc1f99e-892c-4f86-b4d4-c662cf505107 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:09.142122 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9dc1f99e-892c-4f86-b4d4-c662cf505107 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:09.142581 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9dc1f99e-892c-4f86-b4d4-c662cf505107 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:09.143025 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9dc1f99e-892c-4f86-b4d4-c662cf505107 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:09.375031 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9dc1f99e-892c-4f86-b4d4-c662cf505107 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:09.389667 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9dc1f99e-892c-4f86-b4d4-c662cf505107 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:09.391033 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9dc1f99e-892c-4f86-b4d4-c662cf505107 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:09.392238 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9dc1f99e-892c-4f86-b4d4-c662cf505107 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1738 microversion: 2.20 time: 0.278167 Aug 29 19:12:09.393010 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 444/878] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:09 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:10.129237 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-61b4dcf3-0a6f-4fa2-8658-aa984365c6ed tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:10.130126 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-61b4dcf3-0a6f-4fa2-8658-aa984365c6ed tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:10.132654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:10.140588 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d4711794-798f-4d71-b5a7-54cbf7cab065 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:10.141340 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d4711794-798f-4d71-b5a7-54cbf7cab065 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:10.141998 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61b4dcf3-0a6f-4fa2-8658-aa984365c6ed tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:10.143058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61b4dcf3-0a6f-4fa2-8658-aa984365c6ed tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:10.143500 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61b4dcf3-0a6f-4fa2-8658-aa984365c6ed tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:10.144575 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61b4dcf3-0a6f-4fa2-8658-aa984365c6ed tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:10.145028 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61b4dcf3-0a6f-4fa2-8658-aa984365c6ed tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:10.145456 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61b4dcf3-0a6f-4fa2-8658-aa984365c6ed tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:10.150398 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4711794-798f-4d71-b5a7-54cbf7cab065 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:10.151199 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4711794-798f-4d71-b5a7-54cbf7cab065 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:10.151823 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4711794-798f-4d71-b5a7-54cbf7cab065 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:10.152692 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4711794-798f-4d71-b5a7-54cbf7cab065 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:10.153426 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4711794-798f-4d71-b5a7-54cbf7cab065 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:10.154009 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4711794-798f-4d71-b5a7-54cbf7cab065 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:10.367482 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d4711794-798f-4d71-b5a7-54cbf7cab065 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:10.377077 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d4711794-798f-4d71-b5a7-54cbf7cab065 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1266 microversion: 2.1 time: 0.240632 Aug 29 19:12:10.390502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-61b4dcf3-0a6f-4fa2-8658-aa984365c6ed tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:10.391952 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 445/879] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:10 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:10.399456 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-61b4dcf3-0a6f-4fa2-8658-aa984365c6ed tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.280992 Aug 29 19:12:10.400040 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 435/880] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:10 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:10.416379 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4663dfcf-76ac-4b7d-8478-29978c29e0a7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:10.417305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4663dfcf-76ac-4b7d-8478-29978c29e0a7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:10.423974 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4663dfcf-76ac-4b7d-8478-29978c29e0a7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:10.424839 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4663dfcf-76ac-4b7d-8478-29978c29e0a7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:10.425535 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4663dfcf-76ac-4b7d-8478-29978c29e0a7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:10.427446 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4663dfcf-76ac-4b7d-8478-29978c29e0a7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:10.428162 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4663dfcf-76ac-4b7d-8478-29978c29e0a7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:10.428943 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4663dfcf-76ac-4b7d-8478-29978c29e0a7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:10.580802 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4663dfcf-76ac-4b7d-8478-29978c29e0a7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:10.596357 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4663dfcf-76ac-4b7d-8478-29978c29e0a7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:10.597828 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4663dfcf-76ac-4b7d-8478-29978c29e0a7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:10.599291 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4663dfcf-76ac-4b7d-8478-29978c29e0a7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1738 microversion: 2.20 time: 0.186566 Aug 29 19:12:10.599735 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 446/881] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:10 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:11.400577 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-86330e8d-dc5f-4dbd-ac54-30426fa7af6d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:11.401338 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-86330e8d-dc5f-4dbd-ac54-30426fa7af6d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:11.407962 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86330e8d-dc5f-4dbd-ac54-30426fa7af6d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:11.408453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86330e8d-dc5f-4dbd-ac54-30426fa7af6d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:11.408891 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86330e8d-dc5f-4dbd-ac54-30426fa7af6d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:11.409593 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86330e8d-dc5f-4dbd-ac54-30426fa7af6d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:11.410692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86330e8d-dc5f-4dbd-ac54-30426fa7af6d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:11.411146 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86330e8d-dc5f-4dbd-ac54-30426fa7af6d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:11.421612 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1060f094-a521-414b-b7ba-567f2e7e0737 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:11.422365 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1060f094-a521-414b-b7ba-567f2e7e0737 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:11.428817 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1060f094-a521-414b-b7ba-567f2e7e0737 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:11.429306 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1060f094-a521-414b-b7ba-567f2e7e0737 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:11.429761 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1060f094-a521-414b-b7ba-567f2e7e0737 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:11.431169 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1060f094-a521-414b-b7ba-567f2e7e0737 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:11.431629 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1060f094-a521-414b-b7ba-567f2e7e0737 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:11.432051 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1060f094-a521-414b-b7ba-567f2e7e0737 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:11.625715 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-86330e8d-dc5f-4dbd-ac54-30426fa7af6d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:11.633919 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-86330e8d-dc5f-4dbd-ac54-30426fa7af6d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1266 microversion: 2.1 time: 0.237804 Aug 29 19:12:11.634481 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 436/882] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:11 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:11.638872 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-06dfbc6f-d0a8-4b6d-b753-7f62aa2bbf6e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:11.639439 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1060f094-a521-414b-b7ba-567f2e7e0737 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:11.639578 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-06dfbc6f-d0a8-4b6d-b753-7f62aa2bbf6e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:11.646980 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06dfbc6f-d0a8-4b6d-b753-7f62aa2bbf6e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:11.647644 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06dfbc6f-d0a8-4b6d-b753-7f62aa2bbf6e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:11.648187 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06dfbc6f-d0a8-4b6d-b753-7f62aa2bbf6e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:11.648996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06dfbc6f-d0a8-4b6d-b753-7f62aa2bbf6e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:11.649455 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06dfbc6f-d0a8-4b6d-b753-7f62aa2bbf6e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:11.649675 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1060f094-a521-414b-b7ba-567f2e7e0737 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.232669 Aug 29 19:12:11.649883 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06dfbc6f-d0a8-4b6d-b753-7f62aa2bbf6e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:11.650268 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 447/883] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:11 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:11.787990 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-06dfbc6f-d0a8-4b6d-b753-7f62aa2bbf6e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:11.790226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:11.797557 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-06dfbc6f-d0a8-4b6d-b753-7f62aa2bbf6e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:11.798979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-06dfbc6f-d0a8-4b6d-b753-7f62aa2bbf6e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:11.800145 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-06dfbc6f-d0a8-4b6d-b753-7f62aa2bbf6e tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1738 microversion: 2.20 time: 0.164767 Aug 29 19:12:11.800703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 437/884] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:11 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:12.412338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2a739527-7277-4459-b6a2-3db887bae023 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:12.412831 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2a739527-7277-4459-b6a2-3db887bae023 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:12.418745 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a739527-7277-4459-b6a2-3db887bae023 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:12.419263 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a739527-7277-4459-b6a2-3db887bae023 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:12.419701 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a739527-7277-4459-b6a2-3db887bae023 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:12.420384 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a739527-7277-4459-b6a2-3db887bae023 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:12.420851 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a739527-7277-4459-b6a2-3db887bae023 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:12.421254 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2a739527-7277-4459-b6a2-3db887bae023 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:12.446979 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2a739527-7277-4459-b6a2-3db887bae023 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/ips" status: 200 len: 146 microversion: 2.1 time: 0.039977 Aug 29 19:12:12.447926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 448/885] 10.222.0.86 () {58 vars in 1248 bytes} [Mon Aug 29 19:12:12 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:12.658369 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9288eb41-3c2e-4854-b7e2-6b21035796bc tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:12.660978 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9288eb41-3c2e-4854-b7e2-6b21035796bc tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:12.670581 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dd879a50-6fd7-4e45-ad64-556b4bec5e3e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:12.671374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dd879a50-6fd7-4e45-ad64-556b4bec5e3e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:12.684226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd879a50-6fd7-4e45-ad64-556b4bec5e3e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:12.685639 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9288eb41-3c2e-4854-b7e2-6b21035796bc tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:12.686228 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9288eb41-3c2e-4854-b7e2-6b21035796bc tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:12.686512 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd879a50-6fd7-4e45-ad64-556b4bec5e3e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:12.687073 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd879a50-6fd7-4e45-ad64-556b4bec5e3e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:12.687611 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9288eb41-3c2e-4854-b7e2-6b21035796bc tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:12.689122 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd879a50-6fd7-4e45-ad64-556b4bec5e3e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:12.689566 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9288eb41-3c2e-4854-b7e2-6b21035796bc tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:12.690149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd879a50-6fd7-4e45-ad64-556b4bec5e3e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:12.691034 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd879a50-6fd7-4e45-ad64-556b4bec5e3e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:12.691492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9288eb41-3c2e-4854-b7e2-6b21035796bc tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:12.691979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9288eb41-3c2e-4854-b7e2-6b21035796bc tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:12.913872 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9288eb41-3c2e-4854-b7e2-6b21035796bc tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:12.917133 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dd879a50-6fd7-4e45-ad64-556b4bec5e3e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:12.921636 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9288eb41-3c2e-4854-b7e2-6b21035796bc tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1266 microversion: 2.1 time: 0.270081 Aug 29 19:12:12.922203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 438/886] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:12 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:12.925241 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dd879a50-6fd7-4e45-ad64-556b4bec5e3e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.258944 Aug 29 19:12:12.931045 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 449/887] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:12 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:12.931187 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-97e2daf6-624e-48ea-9853-b97f6ecdc444 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:12.931187 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-97e2daf6-624e-48ea-9853-b97f6ecdc444 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:12.933439 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97e2daf6-624e-48ea-9853-b97f6ecdc444 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:12.933923 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97e2daf6-624e-48ea-9853-b97f6ecdc444 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:12.934558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97e2daf6-624e-48ea-9853-b97f6ecdc444 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:12.935278 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97e2daf6-624e-48ea-9853-b97f6ecdc444 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:12.935728 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97e2daf6-624e-48ea-9853-b97f6ecdc444 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:12.936144 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-97e2daf6-624e-48ea-9853-b97f6ecdc444 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:13.218171 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-97e2daf6-624e-48ea-9853-b97f6ecdc444 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:13.226191 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-97e2daf6-624e-48ea-9853-b97f6ecdc444 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:13.227651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-97e2daf6-624e-48ea-9853-b97f6ecdc444 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:13.228792 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-97e2daf6-624e-48ea-9853-b97f6ecdc444 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1738 microversion: 2.20 time: 0.305694 Aug 29 19:12:13.229334 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 439/888] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:12 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1738 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:13.790537 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a3bfdd29-9635-4d97-b2c5-2c3e5cedd355 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e13b6b9b-c815-49db-b2f4-41a9d2fc88a3"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:13.793112 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a3bfdd29-9635-4d97-b2c5-2c3e5cedd355 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:13.801546 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3bfdd29-9635-4d97-b2c5-2c3e5cedd355 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:13.802066 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3bfdd29-9635-4d97-b2c5-2c3e5cedd355 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:13.802549 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3bfdd29-9635-4d97-b2c5-2c3e5cedd355 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:13.803372 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3bfdd29-9635-4d97-b2c5-2c3e5cedd355 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:13.803922 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3bfdd29-9635-4d97-b2c5-2c3e5cedd355 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:13.804405 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3bfdd29-9635-4d97-b2c5-2c3e5cedd355 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:13.942549 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a1a03bce-1f32-42e0-b515-49a62f34c336 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:13.943560 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a1a03bce-1f32-42e0-b515-49a62f34c336 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:13.950251 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a1a03bce-1f32-42e0-b515-49a62f34c336 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:13.950738 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a1a03bce-1f32-42e0-b515-49a62f34c336 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:13.951279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a1a03bce-1f32-42e0-b515-49a62f34c336 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:13.951969 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a1a03bce-1f32-42e0-b515-49a62f34c336 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:13.952421 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a1a03bce-1f32-42e0-b515-49a62f34c336 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:13.952847 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a1a03bce-1f32-42e0-b515-49a62f34c336 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:14.085649 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a1a03bce-1f32-42e0-b515-49a62f34c336 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:14.093283 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a1a03bce-1f32-42e0-b515-49a62f34c336 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1266 microversion: 2.1 time: 0.155520 Aug 29 19:12:14.093837 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 440/889] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:13 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:14.098675 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b7d2fc1b-2ca9-4eb2-bc62-8abeec227966 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:14.099294 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b7d2fc1b-2ca9-4eb2-bc62-8abeec227966 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:14.104764 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7d2fc1b-2ca9-4eb2-bc62-8abeec227966 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:14.105242 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7d2fc1b-2ca9-4eb2-bc62-8abeec227966 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:14.105674 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7d2fc1b-2ca9-4eb2-bc62-8abeec227966 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:14.106357 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7d2fc1b-2ca9-4eb2-bc62-8abeec227966 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:14.106804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7d2fc1b-2ca9-4eb2-bc62-8abeec227966 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:14.107249 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7d2fc1b-2ca9-4eb2-bc62-8abeec227966 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:14.240103 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b7d2fc1b-2ca9-4eb2-bc62-8abeec227966 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:14.249374 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b7d2fc1b-2ca9-4eb2-bc62-8abeec227966 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.154577 Aug 29 19:12:14.250122 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 441/890] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:14 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:14.255399 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5f291651-0316-420f-81e8-de3cb202c09c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:14.256003 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5f291651-0316-420f-81e8-de3cb202c09c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:14.261810 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f291651-0316-420f-81e8-de3cb202c09c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:14.262299 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f291651-0316-420f-81e8-de3cb202c09c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:14.262740 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f291651-0316-420f-81e8-de3cb202c09c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:14.263457 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f291651-0316-420f-81e8-de3cb202c09c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:14.263909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f291651-0316-420f-81e8-de3cb202c09c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:14.264327 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f291651-0316-420f-81e8-de3cb202c09c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:14.398866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5f291651-0316-420f-81e8-de3cb202c09c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:14.406953 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5f291651-0316-420f-81e8-de3cb202c09c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:14.408421 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5f291651-0316-420f-81e8-de3cb202c09c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:14.409613 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5f291651-0316-420f-81e8-de3cb202c09c tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1720 microversion: 2.20 time: 0.157841 Aug 29 19:12:14.410766 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 442/891] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:14 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:14.902153 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=4 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:15.114237 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c07760b0-875c-42d4-97cc-1e2472b36ca8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:15.114949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c07760b0-875c-42d4-97cc-1e2472b36ca8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:15.122199 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c07760b0-875c-42d4-97cc-1e2472b36ca8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:15.122653 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c07760b0-875c-42d4-97cc-1e2472b36ca8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:15.123114 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c07760b0-875c-42d4-97cc-1e2472b36ca8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:15.123813 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c07760b0-875c-42d4-97cc-1e2472b36ca8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:15.124264 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c07760b0-875c-42d4-97cc-1e2472b36ca8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:15.124679 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c07760b0-875c-42d4-97cc-1e2472b36ca8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:15.259618 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c07760b0-875c-42d4-97cc-1e2472b36ca8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:15.267553 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c07760b0-875c-42d4-97cc-1e2472b36ca8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1266 microversion: 2.1 time: 0.157480 Aug 29 19:12:15.268114 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 443/892] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:15 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:15.272567 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6d0a2dc9-390b-4d27-a2ce-42e3fe3723c4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:15.273167 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6d0a2dc9-390b-4d27-a2ce-42e3fe3723c4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:15.278782 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6d0a2dc9-390b-4d27-a2ce-42e3fe3723c4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:15.279310 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6d0a2dc9-390b-4d27-a2ce-42e3fe3723c4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:15.279745 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6d0a2dc9-390b-4d27-a2ce-42e3fe3723c4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:15.280433 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6d0a2dc9-390b-4d27-a2ce-42e3fe3723c4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:15.281143 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6d0a2dc9-390b-4d27-a2ce-42e3fe3723c4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:15.281474 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6d0a2dc9-390b-4d27-a2ce-42e3fe3723c4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:15.331289 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=14 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:15.413305 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6d0a2dc9-390b-4d27-a2ce-42e3fe3723c4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:15.421089 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6d0a2dc9-390b-4d27-a2ce-42e3fe3723c4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.152043 Aug 29 19:12:15.421802 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 444/893] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:15 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:15.433690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-91bc83e9-6953-45a8-84c8-6dab9e204852 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:15.434332 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-91bc83e9-6953-45a8-84c8-6dab9e204852 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:15.440503 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-91bc83e9-6953-45a8-84c8-6dab9e204852 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:15.441545 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-91bc83e9-6953-45a8-84c8-6dab9e204852 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:15.442038 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-91bc83e9-6953-45a8-84c8-6dab9e204852 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:15.442765 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-91bc83e9-6953-45a8-84c8-6dab9e204852 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:15.443312 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-91bc83e9-6953-45a8-84c8-6dab9e204852 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:15.443759 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-91bc83e9-6953-45a8-84c8-6dab9e204852 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:15.578113 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-91bc83e9-6953-45a8-84c8-6dab9e204852 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:15.587054 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-91bc83e9-6953-45a8-84c8-6dab9e204852 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:15.588549 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-91bc83e9-6953-45a8-84c8-6dab9e204852 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:15.589774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-91bc83e9-6953-45a8-84c8-6dab9e204852 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1720 microversion: 2.20 time: 0.160131 Aug 29 19:12:15.590424 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 445/894] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:15 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:12:15.829818 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:15.849607 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a3bfdd29-9635-4d97-b2c5-2c3e5cedd355 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "POST /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.063231 Aug 29 19:12:15.850213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 450/895] 10.222.0.86 () {60 vars in 1323 bytes} [Mon Aug 29 19:12:13 2022] POST /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments => generated 194 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:16.288411 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-387d8f24-236c-4734-8cd0-ce4c7c87e405 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:16.289122 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-387d8f24-236c-4734-8cd0-ce4c7c87e405 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:16.295365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-387d8f24-236c-4734-8cd0-ce4c7c87e405 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:16.295851 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-387d8f24-236c-4734-8cd0-ce4c7c87e405 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:16.296285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-387d8f24-236c-4734-8cd0-ce4c7c87e405 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:16.296981 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-387d8f24-236c-4734-8cd0-ce4c7c87e405 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:16.297433 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-387d8f24-236c-4734-8cd0-ce4c7c87e405 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:16.297858 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-387d8f24-236c-4734-8cd0-ce4c7c87e405 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:16.354290 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-74248cdc-08ee-4e64-b73e-c021fc677a09 req-c18cb152-fbb6-4eab-8e03-05ca0a9ec6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b03fc5b-3bcc-4a6a-af76-aec661abea8c", "name": "network-vif-plugged", "status": "completed", "tag": "59b795aa-8009-4683-ad8c-ae35ee12bb84"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:16.367371 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-74248cdc-08ee-4e64-b73e-c021fc677a09 req-c18cb152-fbb6-4eab-8e03-05ca0a9ec6a5 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:16.368151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-74248cdc-08ee-4e64-b73e-c021fc677a09 req-c18cb152-fbb6-4eab-8e03-05ca0a9ec6a5 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:16.368575 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-74248cdc-08ee-4e64-b73e-c021fc677a09 req-c18cb152-fbb6-4eab-8e03-05ca0a9ec6a5 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:16.379650 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-74248cdc-08ee-4e64-b73e-c021fc677a09 req-c18cb152-fbb6-4eab-8e03-05ca0a9ec6a5 service nova] Creating event network-vif-plugged:59b795aa-8009-4683-ad8c-ae35ee12bb84 for instance 1b03fc5b-3bcc-4a6a-af76-aec661abea8c on hv-cinder-85083 Aug 29 19:12:16.384378 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-74248cdc-08ee-4e64-b73e-c021fc677a09 req-c18cb152-fbb6-4eab-8e03-05ca0a9ec6a5 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037075 Aug 29 19:12:16.384981 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 451/896] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:12:16.439386 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-387d8f24-236c-4734-8cd0-ce4c7c87e405 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:16.444602 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a8711531-7f69-481b-ad42-ee9b77219bac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:16.445384 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a8711531-7f69-481b-ad42-ee9b77219bac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:16.452651 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8711531-7f69-481b-ad42-ee9b77219bac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:16.453207 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8711531-7f69-481b-ad42-ee9b77219bac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:16.453869 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8711531-7f69-481b-ad42-ee9b77219bac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:16.454636 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8711531-7f69-481b-ad42-ee9b77219bac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:16.455218 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8711531-7f69-481b-ad42-ee9b77219bac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:16.455709 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8711531-7f69-481b-ad42-ee9b77219bac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:16.456102 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-387d8f24-236c-4734-8cd0-ce4c7c87e405 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1266 microversion: 2.1 time: 0.171931 Aug 29 19:12:16.456793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 446/897] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:16 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:16.601655 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a8711531-7f69-481b-ad42-ee9b77219bac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:16.609575 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a8711531-7f69-481b-ad42-ee9b77219bac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.169848 Aug 29 19:12:16.610073 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 452/898] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:16 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:16.612636 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-07af0f31-75bf-4f1a-9822-0f4d22e04ed2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:16.613778 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-07af0f31-75bf-4f1a-9822-0f4d22e04ed2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:16.621821 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-07af0f31-75bf-4f1a-9822-0f4d22e04ed2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:16.622725 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-07af0f31-75bf-4f1a-9822-0f4d22e04ed2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:16.623379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-07af0f31-75bf-4f1a-9822-0f4d22e04ed2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:16.624246 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-07af0f31-75bf-4f1a-9822-0f4d22e04ed2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:16.624849 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-07af0f31-75bf-4f1a-9822-0f4d22e04ed2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:16.625886 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-07af0f31-75bf-4f1a-9822-0f4d22e04ed2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:16.774806 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-07af0f31-75bf-4f1a-9822-0f4d22e04ed2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:16.782904 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-07af0f31-75bf-4f1a-9822-0f4d22e04ed2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:16.784363 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-07af0f31-75bf-4f1a-9822-0f4d22e04ed2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:16.785617 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-07af0f31-75bf-4f1a-9822-0f4d22e04ed2 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1723 microversion: 2.20 time: 0.177023 Aug 29 19:12:16.786164 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 447/899] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:16 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:16.808746 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4a342704-ad24-40d6-827e-ba477011f8f9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef8f1684-4cb1-420b-ac9f-16abfde63e81"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:16.811274 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4a342704-ad24-40d6-827e-ba477011f8f9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:16.818341 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a342704-ad24-40d6-827e-ba477011f8f9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:16.818852 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a342704-ad24-40d6-827e-ba477011f8f9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:16.819309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a342704-ad24-40d6-827e-ba477011f8f9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:16.819993 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a342704-ad24-40d6-827e-ba477011f8f9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:16.820439 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a342704-ad24-40d6-827e-ba477011f8f9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:16.820854 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a342704-ad24-40d6-827e-ba477011f8f9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.093926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4a342704-ad24-40d6-827e-ba477011f8f9 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "POST /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.289145 Aug 29 19:12:17.094521 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 453/900] 10.222.0.86 () {62 vars in 1364 bytes} [Mon Aug 29 19:12:16 2022] POST /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e/os-volume_attachments => generated 188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 19:12:17.218208 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e5b59111-0f1d-4463-860f-e8264b0fd8d5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:17.218700 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e5b59111-0f1d-4463-860f-e8264b0fd8d5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:17.225475 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5b59111-0f1d-4463-860f-e8264b0fd8d5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.225956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5b59111-0f1d-4463-860f-e8264b0fd8d5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.226388 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5b59111-0f1d-4463-860f-e8264b0fd8d5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.227123 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5b59111-0f1d-4463-860f-e8264b0fd8d5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.227579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5b59111-0f1d-4463-860f-e8264b0fd8d5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.227997 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5b59111-0f1d-4463-860f-e8264b0fd8d5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.476980 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2e54c469-2eb7-4cfd-9987-80b1a9e29d85 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:17.477702 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2e54c469-2eb7-4cfd-9987-80b1a9e29d85 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:17.484599 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e54c469-2eb7-4cfd-9987-80b1a9e29d85 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.485163 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e54c469-2eb7-4cfd-9987-80b1a9e29d85 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.485757 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e54c469-2eb7-4cfd-9987-80b1a9e29d85 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.486486 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e54c469-2eb7-4cfd-9987-80b1a9e29d85 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.487115 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e54c469-2eb7-4cfd-9987-80b1a9e29d85 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.487671 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e54c469-2eb7-4cfd-9987-80b1a9e29d85 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.489239 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e5b59111-0f1d-4463-860f-e8264b0fd8d5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "DELETE /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e/os-volume_attachments/ef8f1684-4cb1-420b-ac9f-16abfde63e81" status: 202 len: 0 microversion: 2.20 time: 0.274952 Aug 29 19:12:17.489835 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 448/901] 10.222.0.86 () {60 vars in 1457 bytes} [Mon Aug 29 19:12:17 2022] DELETE /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e/os-volume_attachments/ef8f1684-4cb1-420b-ac9f-16abfde63e81 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:12:17.549860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-83e53eb3-b196-4f00-8070-ea96f33e55b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:17.550754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-83e53eb3-b196-4f00-8070-ea96f33e55b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:17.557373 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83e53eb3-b196-4f00-8070-ea96f33e55b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.557966 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83e53eb3-b196-4f00-8070-ea96f33e55b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.558467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83e53eb3-b196-4f00-8070-ea96f33e55b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.559252 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83e53eb3-b196-4f00-8070-ea96f33e55b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.559777 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83e53eb3-b196-4f00-8070-ea96f33e55b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.560285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83e53eb3-b196-4f00-8070-ea96f33e55b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.591841 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-83e53eb3-b196-4f00-8070-ea96f33e55b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120708) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 19:12:17.627354 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2e54c469-2eb7-4cfd-9987-80b1a9e29d85 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:17.638056 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2e54c469-2eb7-4cfd-9987-80b1a9e29d85 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1266 microversion: 2.1 time: 0.165354 Aug 29 19:12:17.638834 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 454/902] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:17 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:17.643617 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1086b910-a676-4dae-b2ff-56cd2ee7afa2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:17.644823 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1086b910-a676-4dae-b2ff-56cd2ee7afa2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:17.651301 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1086b910-a676-4dae-b2ff-56cd2ee7afa2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.651812 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1086b910-a676-4dae-b2ff-56cd2ee7afa2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.652353 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1086b910-a676-4dae-b2ff-56cd2ee7afa2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.653056 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1086b910-a676-4dae-b2ff-56cd2ee7afa2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.653513 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1086b910-a676-4dae-b2ff-56cd2ee7afa2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.653951 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1086b910-a676-4dae-b2ff-56cd2ee7afa2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.666402 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-83e53eb3-b196-4f00-8070-ea96f33e55b0 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "POST /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e/action" status: 202 len: 0 microversion: 2.20 time: 0.120539 Aug 29 19:12:17.667052 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 449/903] 10.222.0.86 () {62 vars in 1319 bytes} [Mon Aug 29 19:12:17 2022] POST /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:12:17.675126 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1b23539d-1267-43b5-880e-f346f3472a8b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:17.675880 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1b23539d-1267-43b5-880e-f346f3472a8b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:17.681984 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b23539d-1267-43b5-880e-f346f3472a8b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.682567 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b23539d-1267-43b5-880e-f346f3472a8b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.683085 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b23539d-1267-43b5-880e-f346f3472a8b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.683793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b23539d-1267-43b5-880e-f346f3472a8b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.684417 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b23539d-1267-43b5-880e-f346f3472a8b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.684846 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b23539d-1267-43b5-880e-f346f3472a8b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.851467 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1086b910-a676-4dae-b2ff-56cd2ee7afa2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:17.859929 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1086b910-a676-4dae-b2ff-56cd2ee7afa2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.219990 Aug 29 19:12:17.860603 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 455/904] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:17 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:17.897730 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1b23539d-1267-43b5-880e-f346f3472a8b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:17.901201 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:17.907599 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1b23539d-1267-43b5-880e-f346f3472a8b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:17.908933 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1b23539d-1267-43b5-880e-f346f3472a8b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:17.910149 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1b23539d-1267-43b5-880e-f346f3472a8b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1671 microversion: 2.20 time: 0.238815 Aug 29 19:12:17.910701 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 450/905] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:17 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1671 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:12:18.400352 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-72ca08f4-469c-4fb1-ac11-ece48dcd90a8 req-b41e39a7-b28d-4d1e-a89b-b39a088aeaff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77353c2d-0418-48b1-a87a-2b6d8cc0f96e", "name": "network-vif-unplugged", "status": "completed", "tag": "67ef5167-9ef6-4f02-967f-ca2f8ed4953a"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:18.409496 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-72ca08f4-469c-4fb1-ac11-ece48dcd90a8 req-b41e39a7-b28d-4d1e-a89b-b39a088aeaff service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:18.410560 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-72ca08f4-469c-4fb1-ac11-ece48dcd90a8 req-b41e39a7-b28d-4d1e-a89b-b39a088aeaff service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:18.410980 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-72ca08f4-469c-4fb1-ac11-ece48dcd90a8 req-b41e39a7-b28d-4d1e-a89b-b39a088aeaff service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:18.423436 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.compute.server_external_events [req-72ca08f4-469c-4fb1-ac11-ece48dcd90a8 req-b41e39a7-b28d-4d1e-a89b-b39a088aeaff service nova] Unable to find a host for instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e. Dropping event network-vif-unplugged {{(pid=120707) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 19:12:18.424283 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-72ca08f4-469c-4fb1-ac11-ece48dcd90a8 req-b41e39a7-b28d-4d1e-a89b-b39a088aeaff service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027751 Aug 29 19:12:18.424842 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 456/906] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 19:12:18.660056 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0281322e-a46a-47e3-8e7d-9f727d30a9e3 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:18.660663 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0281322e-a46a-47e3-8e7d-9f727d30a9e3 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:18.668648 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0281322e-a46a-47e3-8e7d-9f727d30a9e3 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:18.669113 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0281322e-a46a-47e3-8e7d-9f727d30a9e3 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:18.669543 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0281322e-a46a-47e3-8e7d-9f727d30a9e3 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:18.670231 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0281322e-a46a-47e3-8e7d-9f727d30a9e3 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:18.670679 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0281322e-a46a-47e3-8e7d-9f727d30a9e3 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:18.671126 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0281322e-a46a-47e3-8e7d-9f727d30a9e3 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:18.818315 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0281322e-a46a-47e3-8e7d-9f727d30a9e3 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:18.826214 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0281322e-a46a-47e3-8e7d-9f727d30a9e3 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1266 microversion: 2.1 time: 0.170255 Aug 29 19:12:18.826781 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 451/907] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:18 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:18.881511 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d06c657e-2d79-4466-a7a8-8ef7786f0193 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:18.882145 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d06c657e-2d79-4466-a7a8-8ef7786f0193 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:18.888606 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d06c657e-2d79-4466-a7a8-8ef7786f0193 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:18.889087 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d06c657e-2d79-4466-a7a8-8ef7786f0193 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:18.889519 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d06c657e-2d79-4466-a7a8-8ef7786f0193 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:18.890200 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d06c657e-2d79-4466-a7a8-8ef7786f0193 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:18.890653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d06c657e-2d79-4466-a7a8-8ef7786f0193 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:18.891107 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d06c657e-2d79-4466-a7a8-8ef7786f0193 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:18.933047 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5fd10601-dfd9-4f37-9b00-cba35449e21d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:18.933694 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5fd10601-dfd9-4f37-9b00-cba35449e21d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:18.939893 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5fd10601-dfd9-4f37-9b00-cba35449e21d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:18.940448 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5fd10601-dfd9-4f37-9b00-cba35449e21d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:18.941643 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5fd10601-dfd9-4f37-9b00-cba35449e21d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:18.942398 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5fd10601-dfd9-4f37-9b00-cba35449e21d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:18.942918 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5fd10601-dfd9-4f37-9b00-cba35449e21d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:18.943421 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5fd10601-dfd9-4f37-9b00-cba35449e21d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:19.093169 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d06c657e-2d79-4466-a7a8-8ef7786f0193 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:19.101361 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d06c657e-2d79-4466-a7a8-8ef7786f0193 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.224219 Aug 29 19:12:19.102014 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 457/908] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:18 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:19.116362 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5fd10601-dfd9-4f37-9b00-cba35449e21d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:19.124445 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5fd10601-dfd9-4f37-9b00-cba35449e21d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:19.125883 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5fd10601-dfd9-4f37-9b00-cba35449e21d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:19.127051 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5fd10601-dfd9-4f37-9b00-cba35449e21d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1671 microversion: 2.20 time: 0.197980 Aug 29 19:12:19.127602 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 452/909] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:18 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1671 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:12:19.845570 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f5d947cb-5cb2-438b-9639-12488554fd31 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:19.846170 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f5d947cb-5cb2-438b-9639-12488554fd31 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:19.853506 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f5d947cb-5cb2-438b-9639-12488554fd31 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:19.853991 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f5d947cb-5cb2-438b-9639-12488554fd31 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:19.854419 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f5d947cb-5cb2-438b-9639-12488554fd31 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:19.855155 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f5d947cb-5cb2-438b-9639-12488554fd31 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:19.855827 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f5d947cb-5cb2-438b-9639-12488554fd31 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:19.856247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f5d947cb-5cb2-438b-9639-12488554fd31 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:19.991687 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f5d947cb-5cb2-438b-9639-12488554fd31 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:19.999428 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f5d947cb-5cb2-438b-9639-12488554fd31 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1453 microversion: 2.1 time: 0.157636 Aug 29 19:12:19.999992 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 458/910] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:19 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:20.019403 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-31139de2-efb6-45da-8931-92fca0f4fb96 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:20.020123 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-31139de2-efb6-45da-8931-92fca0f4fb96 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:20.026794 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31139de2-efb6-45da-8931-92fca0f4fb96 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:20.027320 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31139de2-efb6-45da-8931-92fca0f4fb96 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:20.027749 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31139de2-efb6-45da-8931-92fca0f4fb96 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:20.028438 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31139de2-efb6-45da-8931-92fca0f4fb96 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:20.028917 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31139de2-efb6-45da-8931-92fca0f4fb96 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:20.029336 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31139de2-efb6-45da-8931-92fca0f4fb96 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:20.121684 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-426799a6-357d-4f93-bbd6-5841f5defee6 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:20.122300 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-426799a6-357d-4f93-bbd6-5841f5defee6 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:20.128729 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-426799a6-357d-4f93-bbd6-5841f5defee6 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:20.129214 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-426799a6-357d-4f93-bbd6-5841f5defee6 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:20.129645 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-426799a6-357d-4f93-bbd6-5841f5defee6 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:20.130341 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-426799a6-357d-4f93-bbd6-5841f5defee6 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:20.130786 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-426799a6-357d-4f93-bbd6-5841f5defee6 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:20.131458 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-426799a6-357d-4f93-bbd6-5841f5defee6 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:20.180786 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-31139de2-efb6-45da-8931-92fca0f4fb96 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:20.188563 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-31139de2-efb6-45da-8931-92fca0f4fb96 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1453 microversion: 2.1 time: 0.173301 Aug 29 19:12:20.189126 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 453/911] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:20 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:20.194313 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a91a5ce0-129b-47cc-bf75-2796fe7505fa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:20.194977 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a91a5ce0-129b-47cc-bf75-2796fe7505fa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:20.201640 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a91a5ce0-129b-47cc-bf75-2796fe7505fa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:20.202828 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a91a5ce0-129b-47cc-bf75-2796fe7505fa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:20.203520 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a91a5ce0-129b-47cc-bf75-2796fe7505fa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:20.204224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a91a5ce0-129b-47cc-bf75-2796fe7505fa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:20.204830 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a91a5ce0-129b-47cc-bf75-2796fe7505fa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:20.205487 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a91a5ce0-129b-47cc-bf75-2796fe7505fa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:20.328728 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-426799a6-357d-4f93-bbd6-5841f5defee6 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:20.339925 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-426799a6-357d-4f93-bbd6-5841f5defee6 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.222038 Aug 29 19:12:20.357535 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 459/912] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:20 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:20.439751 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a91a5ce0-129b-47cc-bf75-2796fe7505fa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:20.450098 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a91a5ce0-129b-47cc-bf75-2796fe7505fa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:20.452052 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a91a5ce0-129b-47cc-bf75-2796fe7505fa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:20.453465 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a91a5ce0-129b-47cc-bf75-2796fe7505fa tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.263398 Aug 29 19:12:20.454193 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 454/913] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:20 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:21.366962 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7432fbb6-2073-486c-b211-789eafc11ae0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:21.367565 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7432fbb6-2073-486c-b211-789eafc11ae0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:21.374068 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7432fbb6-2073-486c-b211-789eafc11ae0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:21.374692 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7432fbb6-2073-486c-b211-789eafc11ae0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:21.375210 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7432fbb6-2073-486c-b211-789eafc11ae0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:21.375979 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7432fbb6-2073-486c-b211-789eafc11ae0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:21.376498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7432fbb6-2073-486c-b211-789eafc11ae0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:21.376982 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7432fbb6-2073-486c-b211-789eafc11ae0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:21.480451 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-17175938-6ea7-4768-b6a1-45d9b1cf3f99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:21.481903 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-17175938-6ea7-4768-b6a1-45d9b1cf3f99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:21.499481 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17175938-6ea7-4768-b6a1-45d9b1cf3f99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:21.501069 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17175938-6ea7-4768-b6a1-45d9b1cf3f99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:21.501674 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17175938-6ea7-4768-b6a1-45d9b1cf3f99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:21.504100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17175938-6ea7-4768-b6a1-45d9b1cf3f99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:21.508088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17175938-6ea7-4768-b6a1-45d9b1cf3f99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:21.509612 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17175938-6ea7-4768-b6a1-45d9b1cf3f99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:21.586012 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7432fbb6-2073-486c-b211-789eafc11ae0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:21.594338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7432fbb6-2073-486c-b211-789eafc11ae0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.232040 Aug 29 19:12:21.597461 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 460/914] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:21 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:21.791780 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-17175938-6ea7-4768-b6a1-45d9b1cf3f99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:21.804203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-17175938-6ea7-4768-b6a1-45d9b1cf3f99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:21.806242 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-17175938-6ea7-4768-b6a1-45d9b1cf3f99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:21.807809 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-17175938-6ea7-4768-b6a1-45d9b1cf3f99 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.332910 Aug 29 19:12:21.808782 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 455/915] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:21 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:22.126723 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-4b7d709b-c37c-44b0-a209-1263adc7e351 req-f0ab0089-e57c-4c0e-a796-3cfc5cf3e2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b03fc5b-3bcc-4a6a-af76-aec661abea8c", "tag": "59b795aa-8009-4683-ad8c-ae35ee12bb84"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:22.140394 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-4b7d709b-c37c-44b0-a209-1263adc7e351 req-f0ab0089-e57c-4c0e-a796-3cfc5cf3e2c2 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:22.141173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-4b7d709b-c37c-44b0-a209-1263adc7e351 req-f0ab0089-e57c-4c0e-a796-3cfc5cf3e2c2 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:22.141768 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-4b7d709b-c37c-44b0-a209-1263adc7e351 req-f0ab0089-e57c-4c0e-a796-3cfc5cf3e2c2 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:22.164408 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-4b7d709b-c37c-44b0-a209-1263adc7e351 req-f0ab0089-e57c-4c0e-a796-3cfc5cf3e2c2 service nova] Creating event network-changed:59b795aa-8009-4683-ad8c-ae35ee12bb84 for instance 1b03fc5b-3bcc-4a6a-af76-aec661abea8c on hv-cinder-85083 Aug 29 19:12:22.171142 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-4b7d709b-c37c-44b0-a209-1263adc7e351 req-f0ab0089-e57c-4c0e-a796-3cfc5cf3e2c2 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048214 Aug 29 19:12:22.171849 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 461/916] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:22.617502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a13666b9-31b5-4138-b102-050a68fa05ce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:22.618123 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a13666b9-31b5-4138-b102-050a68fa05ce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:22.624768 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a13666b9-31b5-4138-b102-050a68fa05ce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:22.625247 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a13666b9-31b5-4138-b102-050a68fa05ce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:22.625683 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a13666b9-31b5-4138-b102-050a68fa05ce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:22.626378 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a13666b9-31b5-4138-b102-050a68fa05ce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:22.626956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a13666b9-31b5-4138-b102-050a68fa05ce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:22.627275 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a13666b9-31b5-4138-b102-050a68fa05ce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:22.642466 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-129df1a2-d722-4b23-9e3c-c5774fda15a0 req-9c0bfcb0-bd1c-4799-821f-46101b9c7e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd46fd90-e3ac-4556-927a-14ce6c51239e", "name": "network-vif-plugged", "status": "completed", "tag": "7b17bd15-64ac-45c7-b33b-22f23076cf55"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:22.653294 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-129df1a2-d722-4b23-9e3c-c5774fda15a0 req-9c0bfcb0-bd1c-4799-821f-46101b9c7e36 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:22.653879 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-129df1a2-d722-4b23-9e3c-c5774fda15a0 req-9c0bfcb0-bd1c-4799-821f-46101b9c7e36 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:22.654438 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-129df1a2-d722-4b23-9e3c-c5774fda15a0 req-9c0bfcb0-bd1c-4799-821f-46101b9c7e36 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:22.666755 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-129df1a2-d722-4b23-9e3c-c5774fda15a0 req-9c0bfcb0-bd1c-4799-821f-46101b9c7e36 service nova] Creating event network-vif-plugged:7b17bd15-64ac-45c7-b33b-22f23076cf55 for instance dd46fd90-e3ac-4556-927a-14ce6c51239e on hv-cinder-85083 Aug 29 19:12:22.671686 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-129df1a2-d722-4b23-9e3c-c5774fda15a0 req-9c0bfcb0-bd1c-4799-821f-46101b9c7e36 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033191 Aug 29 19:12:22.672502 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 462/917] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:12:22.764971 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a13666b9-31b5-4138-b102-050a68fa05ce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:22.773879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a13666b9-31b5-4138-b102-050a68fa05ce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.160384 Aug 29 19:12:22.774484 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 456/918] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:22 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:22.832940 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4a535eab-3e58-4551-865a-9594a3f3c499 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:22.833916 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4a535eab-3e58-4551-865a-9594a3f3c499 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:22.840850 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a535eab-3e58-4551-865a-9594a3f3c499 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:22.841346 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a535eab-3e58-4551-865a-9594a3f3c499 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:22.841821 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a535eab-3e58-4551-865a-9594a3f3c499 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:22.842574 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a535eab-3e58-4551-865a-9594a3f3c499 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:22.843305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a535eab-3e58-4551-865a-9594a3f3c499 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:22.843775 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a535eab-3e58-4551-865a-9594a3f3c499 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:23.004605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4a535eab-3e58-4551-865a-9594a3f3c499 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:23.017543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4a535eab-3e58-4551-865a-9594a3f3c499 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:23.019558 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4a535eab-3e58-4551-865a-9594a3f3c499 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:23.020754 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4a535eab-3e58-4551-865a-9594a3f3c499 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.193110 Aug 29 19:12:23.021507 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 463/919] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:22 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:23.794881 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ef95cf3d-c162-4f70-b727-d38eadbf2623 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:23.795559 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ef95cf3d-c162-4f70-b727-d38eadbf2623 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:23.803247 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef95cf3d-c162-4f70-b727-d38eadbf2623 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:23.804030 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef95cf3d-c162-4f70-b727-d38eadbf2623 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:23.804472 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef95cf3d-c162-4f70-b727-d38eadbf2623 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:23.805212 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef95cf3d-c162-4f70-b727-d38eadbf2623 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:23.805670 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef95cf3d-c162-4f70-b727-d38eadbf2623 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:23.806116 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef95cf3d-c162-4f70-b727-d38eadbf2623 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:23.945883 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ef95cf3d-c162-4f70-b727-d38eadbf2623 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:23.953990 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ef95cf3d-c162-4f70-b727-d38eadbf2623 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.162999 Aug 29 19:12:23.954557 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 457/920] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:23 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:24.047024 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e585d6aa-e2a3-44d6-940d-0bb0c29e3299 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:24.049234 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e585d6aa-e2a3-44d6-940d-0bb0c29e3299 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:24.077448 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e585d6aa-e2a3-44d6-940d-0bb0c29e3299 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:24.078424 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e585d6aa-e2a3-44d6-940d-0bb0c29e3299 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:24.079958 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e585d6aa-e2a3-44d6-940d-0bb0c29e3299 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:24.081302 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e585d6aa-e2a3-44d6-940d-0bb0c29e3299 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:24.082550 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e585d6aa-e2a3-44d6-940d-0bb0c29e3299 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:24.083200 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e585d6aa-e2a3-44d6-940d-0bb0c29e3299 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:24.280945 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e585d6aa-e2a3-44d6-940d-0bb0c29e3299 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:24.291255 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e585d6aa-e2a3-44d6-940d-0bb0c29e3299 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:24.292809 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e585d6aa-e2a3-44d6-940d-0bb0c29e3299 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:24.294376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e585d6aa-e2a3-44d6-940d-0bb0c29e3299 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.253733 Aug 29 19:12:24.309599 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 464/921] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:24 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:24.975397 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cb3b2826-40a5-4318-95f5-591dfd662074 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:24.975994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-cb3b2826-40a5-4318-95f5-591dfd662074 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:24.983163 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb3b2826-40a5-4318-95f5-591dfd662074 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:24.983684 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb3b2826-40a5-4318-95f5-591dfd662074 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:24.984401 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb3b2826-40a5-4318-95f5-591dfd662074 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:24.985227 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb3b2826-40a5-4318-95f5-591dfd662074 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:24.985719 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb3b2826-40a5-4318-95f5-591dfd662074 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:24.986191 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb3b2826-40a5-4318-95f5-591dfd662074 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:25.124815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-cb3b2826-40a5-4318-95f5-591dfd662074 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:25.132762 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-cb3b2826-40a5-4318-95f5-591dfd662074 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.161391 Aug 29 19:12:25.133332 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 458/922] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:24 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:25.317698 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-73111617-0874-45e9-b829-966ed44588ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:25.318437 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-73111617-0874-45e9-b829-966ed44588ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:25.325631 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73111617-0874-45e9-b829-966ed44588ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:25.326121 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73111617-0874-45e9-b829-966ed44588ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:25.326550 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73111617-0874-45e9-b829-966ed44588ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:25.327266 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73111617-0874-45e9-b829-966ed44588ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:25.327722 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73111617-0874-45e9-b829-966ed44588ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:25.328143 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73111617-0874-45e9-b829-966ed44588ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:25.623680 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-73111617-0874-45e9-b829-966ed44588ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:25.632774 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-73111617-0874-45e9-b829-966ed44588ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:25.634582 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-73111617-0874-45e9-b829-966ed44588ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:25.636232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-73111617-0874-45e9-b829-966ed44588ff tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.323280 Aug 29 19:12:25.638368 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 465/923] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:25 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:26.154149 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b288fc2d-257c-4645-a6f4-30185a0e6473 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:26.154782 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b288fc2d-257c-4645-a6f4-30185a0e6473 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:26.161558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b288fc2d-257c-4645-a6f4-30185a0e6473 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:26.162042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b288fc2d-257c-4645-a6f4-30185a0e6473 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:26.162472 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b288fc2d-257c-4645-a6f4-30185a0e6473 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:26.163205 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b288fc2d-257c-4645-a6f4-30185a0e6473 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:26.163658 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b288fc2d-257c-4645-a6f4-30185a0e6473 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:26.164086 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b288fc2d-257c-4645-a6f4-30185a0e6473 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:26.326333 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b288fc2d-257c-4645-a6f4-30185a0e6473 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:26.334757 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b288fc2d-257c-4645-a6f4-30185a0e6473 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.184495 Aug 29 19:12:26.335858 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 459/924] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:26 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:26.661010 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-93f27931-357c-44ee-ae41-fefed8052863 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:26.662470 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-93f27931-357c-44ee-ae41-fefed8052863 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:26.669229 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93f27931-357c-44ee-ae41-fefed8052863 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:26.669712 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93f27931-357c-44ee-ae41-fefed8052863 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:26.670181 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93f27931-357c-44ee-ae41-fefed8052863 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:26.670901 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93f27931-357c-44ee-ae41-fefed8052863 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:26.671439 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93f27931-357c-44ee-ae41-fefed8052863 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:26.671808 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-93f27931-357c-44ee-ae41-fefed8052863 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:26.807156 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-93f27931-357c-44ee-ae41-fefed8052863 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:26.815762 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-93f27931-357c-44ee-ae41-fefed8052863 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:26.817217 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-93f27931-357c-44ee-ae41-fefed8052863 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:26.818378 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-93f27931-357c-44ee-ae41-fefed8052863 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.162042 Aug 29 19:12:26.819153 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 466/925] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:26 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:27.355921 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-282ac726-e670-4908-9bae-324cf35431b9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:27.356706 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-282ac726-e670-4908-9bae-324cf35431b9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:27.358865 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:27.364789 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-282ac726-e670-4908-9bae-324cf35431b9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:27.365456 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-282ac726-e670-4908-9bae-324cf35431b9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:27.365891 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-282ac726-e670-4908-9bae-324cf35431b9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:27.366777 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-282ac726-e670-4908-9bae-324cf35431b9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:27.367389 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-282ac726-e670-4908-9bae-324cf35431b9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:27.367975 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-282ac726-e670-4908-9bae-324cf35431b9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:27.517536 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-282ac726-e670-4908-9bae-324cf35431b9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:27.526222 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-282ac726-e670-4908-9bae-324cf35431b9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.174107 Aug 29 19:12:27.526966 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 460/926] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:27 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:27.842329 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6ae0d06c-9b2a-4b9e-9fc6-31fab71b8b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:27.843081 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6ae0d06c-9b2a-4b9e-9fc6-31fab71b8b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:27.845750 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:27.855606 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6ae0d06c-9b2a-4b9e-9fc6-31fab71b8b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:27.856218 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6ae0d06c-9b2a-4b9e-9fc6-31fab71b8b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:27.856706 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6ae0d06c-9b2a-4b9e-9fc6-31fab71b8b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:27.857412 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6ae0d06c-9b2a-4b9e-9fc6-31fab71b8b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:27.858084 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6ae0d06c-9b2a-4b9e-9fc6-31fab71b8b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:27.858523 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6ae0d06c-9b2a-4b9e-9fc6-31fab71b8b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:27.864773 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:28.022579 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6ae0d06c-9b2a-4b9e-9fc6-31fab71b8b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:28.034175 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6ae0d06c-9b2a-4b9e-9fc6-31fab71b8b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:28.035815 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6ae0d06c-9b2a-4b9e-9fc6-31fab71b8b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:28.037089 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6ae0d06c-9b2a-4b9e-9fc6-31fab71b8b8a tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.198880 Aug 29 19:12:28.037932 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 467/927] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:27 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:28.547182 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2797fb7a-2558-4b55-80c6-f3688ce4f640 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:28.547879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2797fb7a-2558-4b55-80c6-f3688ce4f640 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:28.555228 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2797fb7a-2558-4b55-80c6-f3688ce4f640 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:28.555724 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2797fb7a-2558-4b55-80c6-f3688ce4f640 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:28.556163 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2797fb7a-2558-4b55-80c6-f3688ce4f640 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:28.556917 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2797fb7a-2558-4b55-80c6-f3688ce4f640 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:28.557325 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2797fb7a-2558-4b55-80c6-f3688ce4f640 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:28.557750 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2797fb7a-2558-4b55-80c6-f3688ce4f640 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:28.721685 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2797fb7a-2558-4b55-80c6-f3688ce4f640 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:28.729625 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2797fb7a-2558-4b55-80c6-f3688ce4f640 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.186417 Aug 29 19:12:28.731053 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 461/928] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:28 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:29.061521 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cfc15dab-166e-44c0-9601-68e7ed6327d8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:29.062689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cfc15dab-166e-44c0-9601-68e7ed6327d8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:29.069212 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfc15dab-166e-44c0-9601-68e7ed6327d8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:29.070090 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfc15dab-166e-44c0-9601-68e7ed6327d8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:29.070754 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfc15dab-166e-44c0-9601-68e7ed6327d8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:29.071719 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfc15dab-166e-44c0-9601-68e7ed6327d8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:29.072254 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfc15dab-166e-44c0-9601-68e7ed6327d8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:29.072740 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfc15dab-166e-44c0-9601-68e7ed6327d8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:29.218383 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cfc15dab-166e-44c0-9601-68e7ed6327d8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:29.227453 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cfc15dab-166e-44c0-9601-68e7ed6327d8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:29.228913 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cfc15dab-166e-44c0-9601-68e7ed6327d8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:29.230076 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cfc15dab-166e-44c0-9601-68e7ed6327d8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.172463 Aug 29 19:12:29.230814 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 468/929] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:29 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:29.751132 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1d179977-a0b0-489e-a946-caa41810876f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:29.751819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1d179977-a0b0-489e-a946-caa41810876f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:29.758801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d179977-a0b0-489e-a946-caa41810876f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:29.759318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d179977-a0b0-489e-a946-caa41810876f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:29.759775 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d179977-a0b0-489e-a946-caa41810876f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:29.760488 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d179977-a0b0-489e-a946-caa41810876f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:29.760968 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d179977-a0b0-489e-a946-caa41810876f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:29.761388 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d179977-a0b0-489e-a946-caa41810876f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:29.889694 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1d179977-a0b0-489e-a946-caa41810876f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:29.897440 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1d179977-a0b0-489e-a946-caa41810876f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.150577 Aug 29 19:12:29.897992 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 462/930] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:29 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:30.252402 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1fa95fe5-8446-4207-81d4-12cf1044b3b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:30.252992 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1fa95fe5-8446-4207-81d4-12cf1044b3b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:30.259465 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1fa95fe5-8446-4207-81d4-12cf1044b3b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:30.259949 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1fa95fe5-8446-4207-81d4-12cf1044b3b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:30.260387 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1fa95fe5-8446-4207-81d4-12cf1044b3b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:30.261074 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1fa95fe5-8446-4207-81d4-12cf1044b3b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:30.261533 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1fa95fe5-8446-4207-81d4-12cf1044b3b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:30.261957 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1fa95fe5-8446-4207-81d4-12cf1044b3b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:30.391815 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1fa95fe5-8446-4207-81d4-12cf1044b3b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:30.400267 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1fa95fe5-8446-4207-81d4-12cf1044b3b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:30.401686 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1fa95fe5-8446-4207-81d4-12cf1044b3b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:30.402860 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1fa95fe5-8446-4207-81d4-12cf1044b3b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.154325 Aug 29 19:12:30.403424 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 469/931] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:30 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:30.917583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3233bd8f-17dd-49da-800d-aeafee18d097 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:30.918213 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3233bd8f-17dd-49da-800d-aeafee18d097 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:30.924833 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3233bd8f-17dd-49da-800d-aeafee18d097 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:30.925821 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3233bd8f-17dd-49da-800d-aeafee18d097 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:30.926255 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3233bd8f-17dd-49da-800d-aeafee18d097 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:30.926936 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3233bd8f-17dd-49da-800d-aeafee18d097 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:30.927409 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3233bd8f-17dd-49da-800d-aeafee18d097 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:30.927833 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3233bd8f-17dd-49da-800d-aeafee18d097 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:31.058006 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3233bd8f-17dd-49da-800d-aeafee18d097 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:31.066819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3233bd8f-17dd-49da-800d-aeafee18d097 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.152289 Aug 29 19:12:31.067742 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 463/932] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:30 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:31.426279 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-eddbd69a-e8c7-4643-ad87-e24ff3fcafe5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:31.426885 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-eddbd69a-e8c7-4643-ad87-e24ff3fcafe5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:31.433269 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eddbd69a-e8c7-4643-ad87-e24ff3fcafe5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:31.433748 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eddbd69a-e8c7-4643-ad87-e24ff3fcafe5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:31.434175 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eddbd69a-e8c7-4643-ad87-e24ff3fcafe5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:31.434850 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eddbd69a-e8c7-4643-ad87-e24ff3fcafe5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:31.435318 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eddbd69a-e8c7-4643-ad87-e24ff3fcafe5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:31.435737 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eddbd69a-e8c7-4643-ad87-e24ff3fcafe5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:31.570828 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-eddbd69a-e8c7-4643-ad87-e24ff3fcafe5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:31.579266 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-eddbd69a-e8c7-4643-ad87-e24ff3fcafe5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:31.580718 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-eddbd69a-e8c7-4643-ad87-e24ff3fcafe5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:31.582577 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-eddbd69a-e8c7-4643-ad87-e24ff3fcafe5 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.160779 Aug 29 19:12:31.583155 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 470/933] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:31 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:32.088495 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3efc0c6c-eb0b-491a-8c30-fca4c3322ee7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:32.089026 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3efc0c6c-eb0b-491a-8c30-fca4c3322ee7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:32.095679 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3efc0c6c-eb0b-491a-8c30-fca4c3322ee7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:32.096161 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3efc0c6c-eb0b-491a-8c30-fca4c3322ee7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:32.096604 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3efc0c6c-eb0b-491a-8c30-fca4c3322ee7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:32.097294 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3efc0c6c-eb0b-491a-8c30-fca4c3322ee7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:32.097749 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3efc0c6c-eb0b-491a-8c30-fca4c3322ee7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:32.098178 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3efc0c6c-eb0b-491a-8c30-fca4c3322ee7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:32.228776 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3efc0c6c-eb0b-491a-8c30-fca4c3322ee7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:32.237080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3efc0c6c-eb0b-491a-8c30-fca4c3322ee7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.152551 Aug 29 19:12:32.237722 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 464/934] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:32 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:32.605619 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3ccb2b39-f5f3-4125-a7d5-8f6b45ab26f4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:32.606236 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3ccb2b39-f5f3-4125-a7d5-8f6b45ab26f4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:32.613282 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3ccb2b39-f5f3-4125-a7d5-8f6b45ab26f4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:32.613773 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3ccb2b39-f5f3-4125-a7d5-8f6b45ab26f4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:32.614214 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3ccb2b39-f5f3-4125-a7d5-8f6b45ab26f4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:32.614906 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3ccb2b39-f5f3-4125-a7d5-8f6b45ab26f4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:32.615388 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3ccb2b39-f5f3-4125-a7d5-8f6b45ab26f4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:32.615813 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3ccb2b39-f5f3-4125-a7d5-8f6b45ab26f4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:32.750285 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3ccb2b39-f5f3-4125-a7d5-8f6b45ab26f4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:32.763832 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3ccb2b39-f5f3-4125-a7d5-8f6b45ab26f4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:32.766458 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3ccb2b39-f5f3-4125-a7d5-8f6b45ab26f4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:32.767651 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3ccb2b39-f5f3-4125-a7d5-8f6b45ab26f4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.166037 Aug 29 19:12:32.768197 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 471/935] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:32 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:33.257782 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-189effbd-394e-42d0-9634-583b7ca09bce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:33.258385 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-189effbd-394e-42d0-9634-583b7ca09bce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:33.264812 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-189effbd-394e-42d0-9634-583b7ca09bce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:33.265284 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-189effbd-394e-42d0-9634-583b7ca09bce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:33.265713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-189effbd-394e-42d0-9634-583b7ca09bce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:33.266389 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-189effbd-394e-42d0-9634-583b7ca09bce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:33.266838 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-189effbd-394e-42d0-9634-583b7ca09bce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:33.267278 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-189effbd-394e-42d0-9634-583b7ca09bce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:33.402979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-189effbd-394e-42d0-9634-583b7ca09bce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:33.411806 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-189effbd-394e-42d0-9634-583b7ca09bce tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.157741 Aug 29 19:12:33.412645 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 465/936] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:33 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:33.792334 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0a25b209-6240-4bb0-81d1-fb41a661ecf1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:33.792944 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0a25b209-6240-4bb0-81d1-fb41a661ecf1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:33.799343 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a25b209-6240-4bb0-81d1-fb41a661ecf1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:33.799831 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a25b209-6240-4bb0-81d1-fb41a661ecf1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:33.800810 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a25b209-6240-4bb0-81d1-fb41a661ecf1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:33.801489 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a25b209-6240-4bb0-81d1-fb41a661ecf1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:33.801975 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a25b209-6240-4bb0-81d1-fb41a661ecf1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:33.802398 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0a25b209-6240-4bb0-81d1-fb41a661ecf1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:33.930501 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0a25b209-6240-4bb0-81d1-fb41a661ecf1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:33.938361 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0a25b209-6240-4bb0-81d1-fb41a661ecf1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:33.939858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0a25b209-6240-4bb0-81d1-fb41a661ecf1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:33.941640 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0a25b209-6240-4bb0-81d1-fb41a661ecf1 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.153181 Aug 29 19:12:33.942184 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 472/937] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:33 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:34.440841 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-17cad3c9-bb36-4718-8859-d9f57a343df0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:34.441983 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-17cad3c9-bb36-4718-8859-d9f57a343df0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:34.450951 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17cad3c9-bb36-4718-8859-d9f57a343df0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:34.451459 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17cad3c9-bb36-4718-8859-d9f57a343df0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:34.452629 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17cad3c9-bb36-4718-8859-d9f57a343df0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:34.453515 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17cad3c9-bb36-4718-8859-d9f57a343df0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:34.453970 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17cad3c9-bb36-4718-8859-d9f57a343df0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:34.454391 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17cad3c9-bb36-4718-8859-d9f57a343df0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:34.591785 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-17cad3c9-bb36-4718-8859-d9f57a343df0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:34.600268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-17cad3c9-bb36-4718-8859-d9f57a343df0 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.164493 Aug 29 19:12:34.600861 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 466/938] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:34 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:34.967580 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e99d5819-e49b-4176-9c7b-55f817f4c7b3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:34.968621 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e99d5819-e49b-4176-9c7b-55f817f4c7b3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:34.980193 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e99d5819-e49b-4176-9c7b-55f817f4c7b3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:34.981216 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e99d5819-e49b-4176-9c7b-55f817f4c7b3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:34.981957 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e99d5819-e49b-4176-9c7b-55f817f4c7b3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:34.983187 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e99d5819-e49b-4176-9c7b-55f817f4c7b3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:34.984163 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e99d5819-e49b-4176-9c7b-55f817f4c7b3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:34.985170 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e99d5819-e49b-4176-9c7b-55f817f4c7b3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:35.173967 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e99d5819-e49b-4176-9c7b-55f817f4c7b3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:35.182514 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e99d5819-e49b-4176-9c7b-55f817f4c7b3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:35.184234 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e99d5819-e49b-4176-9c7b-55f817f4c7b3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:35.186049 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e99d5819-e49b-4176-9c7b-55f817f4c7b3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.225314 Aug 29 19:12:35.186887 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 473/939] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:34 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:12:35.620828 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8d187a84-1cd7-47af-9bf0-384c53b1d97b tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:35.621517 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8d187a84-1cd7-47af-9bf0-384c53b1d97b tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:35.628486 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8d187a84-1cd7-47af-9bf0-384c53b1d97b tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:35.628971 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8d187a84-1cd7-47af-9bf0-384c53b1d97b tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:35.629407 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8d187a84-1cd7-47af-9bf0-384c53b1d97b tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:35.630093 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8d187a84-1cd7-47af-9bf0-384c53b1d97b tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:35.630543 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8d187a84-1cd7-47af-9bf0-384c53b1d97b tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:35.630968 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8d187a84-1cd7-47af-9bf0-384c53b1d97b tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:35.649542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:35.759668 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8d187a84-1cd7-47af-9bf0-384c53b1d97b tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:35.767404 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8d187a84-1cd7-47af-9bf0-384c53b1d97b tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.150435 Aug 29 19:12:35.767960 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 467/940] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:35 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:36.211333 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-913a0c84-0cb8-4dd8-8eb1-d128c4fcf7bb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:36.211946 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-913a0c84-0cb8-4dd8-8eb1-d128c4fcf7bb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:36.218582 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-913a0c84-0cb8-4dd8-8eb1-d128c4fcf7bb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:36.219100 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-913a0c84-0cb8-4dd8-8eb1-d128c4fcf7bb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:36.219540 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-913a0c84-0cb8-4dd8-8eb1-d128c4fcf7bb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:36.220226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-913a0c84-0cb8-4dd8-8eb1-d128c4fcf7bb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:36.220685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-913a0c84-0cb8-4dd8-8eb1-d128c4fcf7bb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:36.221107 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-913a0c84-0cb8-4dd8-8eb1-d128c4fcf7bb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:36.350505 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-913a0c84-0cb8-4dd8-8eb1-d128c4fcf7bb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:36.358500 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-913a0c84-0cb8-4dd8-8eb1-d128c4fcf7bb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:36.359878 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-913a0c84-0cb8-4dd8-8eb1-d128c4fcf7bb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:36.361025 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-913a0c84-0cb8-4dd8-8eb1-d128c4fcf7bb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.153620 Aug 29 19:12:36.361572 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 474/941] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:36 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:36.787861 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2aa3c30a-7ad8-4f3e-9fa6-2846c602ec58 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:36.788465 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2aa3c30a-7ad8-4f3e-9fa6-2846c602ec58 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:36.794953 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2aa3c30a-7ad8-4f3e-9fa6-2846c602ec58 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:36.795466 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2aa3c30a-7ad8-4f3e-9fa6-2846c602ec58 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:36.795901 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2aa3c30a-7ad8-4f3e-9fa6-2846c602ec58 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:36.796584 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2aa3c30a-7ad8-4f3e-9fa6-2846c602ec58 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:36.797035 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2aa3c30a-7ad8-4f3e-9fa6-2846c602ec58 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:36.797456 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2aa3c30a-7ad8-4f3e-9fa6-2846c602ec58 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:36.926049 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2aa3c30a-7ad8-4f3e-9fa6-2846c602ec58 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:36.933644 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2aa3c30a-7ad8-4f3e-9fa6-2846c602ec58 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.149671 Aug 29 19:12:36.934205 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 468/942] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:36 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:37.384075 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e15c0e39-a520-49c0-a8ce-c91bb3244afb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:37.384705 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e15c0e39-a520-49c0-a8ce-c91bb3244afb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:37.391072 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e15c0e39-a520-49c0-a8ce-c91bb3244afb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:37.391555 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e15c0e39-a520-49c0-a8ce-c91bb3244afb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:37.391982 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e15c0e39-a520-49c0-a8ce-c91bb3244afb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:37.392666 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e15c0e39-a520-49c0-a8ce-c91bb3244afb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:37.393113 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e15c0e39-a520-49c0-a8ce-c91bb3244afb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:37.393527 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e15c0e39-a520-49c0-a8ce-c91bb3244afb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:37.523589 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e15c0e39-a520-49c0-a8ce-c91bb3244afb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:37.531705 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e15c0e39-a520-49c0-a8ce-c91bb3244afb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:37.533164 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e15c0e39-a520-49c0-a8ce-c91bb3244afb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:37.534325 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e15c0e39-a520-49c0-a8ce-c91bb3244afb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.154108 Aug 29 19:12:37.535053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 475/943] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:37 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:37.954920 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2ca74739-9cc1-400b-a898-68687f62b6a4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:37.955563 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2ca74739-9cc1-400b-a898-68687f62b6a4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:37.962555 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ca74739-9cc1-400b-a898-68687f62b6a4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:37.963066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ca74739-9cc1-400b-a898-68687f62b6a4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:37.963505 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ca74739-9cc1-400b-a898-68687f62b6a4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:37.964190 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ca74739-9cc1-400b-a898-68687f62b6a4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:37.964641 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ca74739-9cc1-400b-a898-68687f62b6a4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:37.965062 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2ca74739-9cc1-400b-a898-68687f62b6a4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:38.094696 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2ca74739-9cc1-400b-a898-68687f62b6a4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:38.102649 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2ca74739-9cc1-400b-a898-68687f62b6a4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.151591 Aug 29 19:12:38.103250 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 469/944] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:37 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:38.557282 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0ad76049-85a9-453c-a8d0-a4212d574546 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:38.557997 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0ad76049-85a9-453c-a8d0-a4212d574546 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:38.564799 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ad76049-85a9-453c-a8d0-a4212d574546 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:38.565415 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ad76049-85a9-453c-a8d0-a4212d574546 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:38.565898 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ad76049-85a9-453c-a8d0-a4212d574546 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:38.566600 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ad76049-85a9-453c-a8d0-a4212d574546 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:38.567074 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ad76049-85a9-453c-a8d0-a4212d574546 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:38.567497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ad76049-85a9-453c-a8d0-a4212d574546 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:38.702369 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0ad76049-85a9-453c-a8d0-a4212d574546 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:38.711046 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0ad76049-85a9-453c-a8d0-a4212d574546 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:38.712575 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0ad76049-85a9-453c-a8d0-a4212d574546 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:38.713720 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0ad76049-85a9-453c-a8d0-a4212d574546 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.160408 Aug 29 19:12:38.714272 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 476/945] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:38 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:39.124308 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d3377025-f06a-4452-8ae5-89d7f8b360c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:39.124924 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d3377025-f06a-4452-8ae5-89d7f8b360c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:39.131311 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3377025-f06a-4452-8ae5-89d7f8b360c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:39.131790 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3377025-f06a-4452-8ae5-89d7f8b360c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:39.132219 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3377025-f06a-4452-8ae5-89d7f8b360c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:39.132898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3377025-f06a-4452-8ae5-89d7f8b360c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:39.133343 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3377025-f06a-4452-8ae5-89d7f8b360c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:39.133756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3377025-f06a-4452-8ae5-89d7f8b360c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:39.268183 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d3377025-f06a-4452-8ae5-89d7f8b360c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:39.276899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d3377025-f06a-4452-8ae5-89d7f8b360c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1258 microversion: 2.1 time: 0.157222 Aug 29 19:12:39.277593 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 470/946] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:39 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:39.376617 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0d9e63be-ea89-44f8-96a3-2c2058ab39b7 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:39.379339 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0d9e63be-ea89-44f8-96a3-2c2058ab39b7 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:39.385265 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d9e63be-ea89-44f8-96a3-2c2058ab39b7 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:39.385752 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d9e63be-ea89-44f8-96a3-2c2058ab39b7 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:39.386189 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d9e63be-ea89-44f8-96a3-2c2058ab39b7 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:39.386875 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d9e63be-ea89-44f8-96a3-2c2058ab39b7 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:39.387359 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d9e63be-ea89-44f8-96a3-2c2058ab39b7 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:39.387783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d9e63be-ea89-44f8-96a3-2c2058ab39b7 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:39.416994 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0d9e63be-ea89-44f8-96a3-2c2058ab39b7 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044551 Aug 29 19:12:39.417538 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 477/947] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:12:39 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:39.428284 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-61f70fde-3d4f-4fe9-9557-df268b748693 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:39.428777 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-61f70fde-3d4f-4fe9-9557-df268b748693 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:39.434915 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61f70fde-3d4f-4fe9-9557-df268b748693 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:39.435433 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61f70fde-3d4f-4fe9-9557-df268b748693 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:39.435866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61f70fde-3d4f-4fe9-9557-df268b748693 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:39.436579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61f70fde-3d4f-4fe9-9557-df268b748693 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:39.437030 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61f70fde-3d4f-4fe9-9557-df268b748693 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:39.437451 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-61f70fde-3d4f-4fe9-9557-df268b748693 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:39.467542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-61f70fde-3d4f-4fe9-9557-df268b748693 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments/e13b6b9b-c815-49db-b2f4-41a9d2fc88a3" status: 200 len: 194 microversion: 2.1 time: 0.043370 Aug 29 19:12:39.468136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 471/948] 10.222.0.86 () {58 vars in 1413 bytes} [Mon Aug 29 19:12:39 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments/e13b6b9b-c815-49db-b2f4-41a9d2fc88a3 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:39.738909 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-66637d83-4006-4137-8e43-dc89dfa2bf11 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:39.739642 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-66637d83-4006-4137-8e43-dc89dfa2bf11 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:39.763291 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-66637d83-4006-4137-8e43-dc89dfa2bf11 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:39.763797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-66637d83-4006-4137-8e43-dc89dfa2bf11 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:39.764238 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-66637d83-4006-4137-8e43-dc89dfa2bf11 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:39.764996 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-66637d83-4006-4137-8e43-dc89dfa2bf11 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:39.766167 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-66637d83-4006-4137-8e43-dc89dfa2bf11 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:39.766559 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-66637d83-4006-4137-8e43-dc89dfa2bf11 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:39.995570 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-66637d83-4006-4137-8e43-dc89dfa2bf11 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:40.003683 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-66637d83-4006-4137-8e43-dc89dfa2bf11 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:40.005119 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-66637d83-4006-4137-8e43-dc89dfa2bf11 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:40.006270 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-66637d83-4006-4137-8e43-dc89dfa2bf11 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.273708 Aug 29 19:12:40.006821 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 478/949] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:39 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:12:40.297879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-af9219d8-6a0f-4cec-b51b-e9d8ee911984 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:40.298601 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-af9219d8-6a0f-4cec-b51b-e9d8ee911984 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:40.305468 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af9219d8-6a0f-4cec-b51b-e9d8ee911984 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:40.305956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af9219d8-6a0f-4cec-b51b-e9d8ee911984 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:40.306392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af9219d8-6a0f-4cec-b51b-e9d8ee911984 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:40.307113 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af9219d8-6a0f-4cec-b51b-e9d8ee911984 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:40.308673 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af9219d8-6a0f-4cec-b51b-e9d8ee911984 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:40.309109 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af9219d8-6a0f-4cec-b51b-e9d8ee911984 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:40.444203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-af9219d8-6a0f-4cec-b51b-e9d8ee911984 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:40.452213 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-af9219d8-6a0f-4cec-b51b-e9d8ee911984 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1443 microversion: 2.1 time: 0.158374 Aug 29 19:12:40.452771 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 472/950] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:40 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:40.472723 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-67e820f6-c533-48d0-9554-6ed1d8263fc5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:40.473331 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-67e820f6-c533-48d0-9554-6ed1d8263fc5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:40.479289 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67e820f6-c533-48d0-9554-6ed1d8263fc5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:40.479772 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67e820f6-c533-48d0-9554-6ed1d8263fc5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:40.480208 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67e820f6-c533-48d0-9554-6ed1d8263fc5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:40.480888 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67e820f6-c533-48d0-9554-6ed1d8263fc5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:40.481343 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67e820f6-c533-48d0-9554-6ed1d8263fc5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:40.481765 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67e820f6-c533-48d0-9554-6ed1d8263fc5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:40.616312 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-67e820f6-c533-48d0-9554-6ed1d8263fc5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:40.624329 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-67e820f6-c533-48d0-9554-6ed1d8263fc5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1443 microversion: 2.1 time: 0.155575 Aug 29 19:12:40.624979 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 479/951] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:40 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:40.801817 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-fe4ba03a-b66e-4f6f-8ebf-90c2319b6114 req-9670ce91-18eb-4af1-93c5-7a6dcf8cbf1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77353c2d-0418-48b1-a87a-2b6d8cc0f96e", "name": "network-vif-plugged", "status": "completed", "tag": "67ef5167-9ef6-4f02-967f-ca2f8ed4953a"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:40.813437 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-fe4ba03a-b66e-4f6f-8ebf-90c2319b6114 req-9670ce91-18eb-4af1-93c5-7a6dcf8cbf1d service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:40.813936 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-fe4ba03a-b66e-4f6f-8ebf-90c2319b6114 req-9670ce91-18eb-4af1-93c5-7a6dcf8cbf1d service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:40.814491 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-fe4ba03a-b66e-4f6f-8ebf-90c2319b6114 req-9670ce91-18eb-4af1-93c5-7a6dcf8cbf1d service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:40.826982 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-fe4ba03a-b66e-4f6f-8ebf-90c2319b6114 req-9670ce91-18eb-4af1-93c5-7a6dcf8cbf1d service nova] Creating event network-vif-plugged:67ef5167-9ef6-4f02-967f-ca2f8ed4953a for instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e on hv-cinder-85083 Aug 29 19:12:40.832616 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-fe4ba03a-b66e-4f6f-8ebf-90c2319b6114 req-9670ce91-18eb-4af1-93c5-7a6dcf8cbf1d service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100682 Aug 29 19:12:40.833295 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 473/952] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:40.834455 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-32392d18-e948-456a-bc68-b55827cd226e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a649f8fa-1458-4b21-8f0a-a4e414056e29"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:40.837692 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-32392d18-e948-456a-bc68-b55827cd226e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:40.844079 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32392d18-e948-456a-bc68-b55827cd226e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:40.844559 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32392d18-e948-456a-bc68-b55827cd226e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:40.845013 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32392d18-e948-456a-bc68-b55827cd226e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:40.845704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32392d18-e948-456a-bc68-b55827cd226e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:40.846232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32392d18-e948-456a-bc68-b55827cd226e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:40.847320 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-32392d18-e948-456a-bc68-b55827cd226e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:41.029988 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-414ddb0d-f207-44cf-9ca6-9a369af63824 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:41.030953 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-414ddb0d-f207-44cf-9ca6-9a369af63824 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:41.037858 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-414ddb0d-f207-44cf-9ca6-9a369af63824 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:41.038664 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-414ddb0d-f207-44cf-9ca6-9a369af63824 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:41.039127 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-414ddb0d-f207-44cf-9ca6-9a369af63824 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:41.039826 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-414ddb0d-f207-44cf-9ca6-9a369af63824 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:41.040286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-414ddb0d-f207-44cf-9ca6-9a369af63824 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:41.041055 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-414ddb0d-f207-44cf-9ca6-9a369af63824 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:41.218330 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-32392d18-e948-456a-bc68-b55827cd226e tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "POST /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387437 Aug 29 19:12:41.219192 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 480/953] 10.222.0.86 () {60 vars in 1323 bytes} [Mon Aug 29 19:12:40 2022] POST /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:41.389491 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-414ddb0d-f207-44cf-9ca6-9a369af63824 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:41.398247 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-414ddb0d-f207-44cf-9ca6-9a369af63824 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:41.399734 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-414ddb0d-f207-44cf-9ca6-9a369af63824 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:41.400898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-414ddb0d-f207-44cf-9ca6-9a369af63824 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.375186 Aug 29 19:12:41.401458 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 474/954] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:41 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:12:42.425688 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4decc279-ead5-4029-8934-c4916c0eb2ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:42.426507 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4decc279-ead5-4029-8934-c4916c0eb2ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:42.433188 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4decc279-ead5-4029-8934-c4916c0eb2ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:42.433670 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4decc279-ead5-4029-8934-c4916c0eb2ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:42.434098 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4decc279-ead5-4029-8934-c4916c0eb2ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:42.434795 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4decc279-ead5-4029-8934-c4916c0eb2ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:42.435268 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4decc279-ead5-4029-8934-c4916c0eb2ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:42.435689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4decc279-ead5-4029-8934-c4916c0eb2ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:42.682409 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4decc279-ead5-4029-8934-c4916c0eb2ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:42.691345 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4decc279-ead5-4029-8934-c4916c0eb2ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:42.692786 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4decc279-ead5-4029-8934-c4916c0eb2ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:42.693956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4decc279-ead5-4029-8934-c4916c0eb2ac tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.273204 Aug 29 19:12:42.694511 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 481/955] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:42 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:42.864683 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-ebdec389-ffe6-4f2c-9838-2eba15bf2ab4 req-5e068389-6981-4b63-a297-c9822d651776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd46fd90-e3ac-4556-927a-14ce6c51239e", "tag": "7b17bd15-64ac-45c7-b33b-22f23076cf55"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:42.874463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ebdec389-ffe6-4f2c-9838-2eba15bf2ab4 req-5e068389-6981-4b63-a297-c9822d651776 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:42.874932 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ebdec389-ffe6-4f2c-9838-2eba15bf2ab4 req-5e068389-6981-4b63-a297-c9822d651776 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:42.875386 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ebdec389-ffe6-4f2c-9838-2eba15bf2ab4 req-5e068389-6981-4b63-a297-c9822d651776 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:42.886792 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-ebdec389-ffe6-4f2c-9838-2eba15bf2ab4 req-5e068389-6981-4b63-a297-c9822d651776 service nova] Creating event network-changed:7b17bd15-64ac-45c7-b33b-22f23076cf55 for instance dd46fd90-e3ac-4556-927a-14ce6c51239e on hv-cinder-85083 Aug 29 19:12:42.892269 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-ebdec389-ffe6-4f2c-9838-2eba15bf2ab4 req-5e068389-6981-4b63-a297-c9822d651776 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031327 Aug 29 19:12:42.893145 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 475/956] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:43.718146 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f9ef613f-c34d-4e11-a183-b0d1bcf1221d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:43.719102 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f9ef613f-c34d-4e11-a183-b0d1bcf1221d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:43.726412 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f9ef613f-c34d-4e11-a183-b0d1bcf1221d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:43.726949 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f9ef613f-c34d-4e11-a183-b0d1bcf1221d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:43.727473 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f9ef613f-c34d-4e11-a183-b0d1bcf1221d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:43.728252 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f9ef613f-c34d-4e11-a183-b0d1bcf1221d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:43.728724 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f9ef613f-c34d-4e11-a183-b0d1bcf1221d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:43.729199 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f9ef613f-c34d-4e11-a183-b0d1bcf1221d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:43.750652 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:43.866614 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f9ef613f-c34d-4e11-a183-b0d1bcf1221d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:43.876232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f9ef613f-c34d-4e11-a183-b0d1bcf1221d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:43.878314 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f9ef613f-c34d-4e11-a183-b0d1bcf1221d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:43.879493 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f9ef613f-c34d-4e11-a183-b0d1bcf1221d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1729 microversion: 2.20 time: 0.165699 Aug 29 19:12:43.891585 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 482/957] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:43 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:44.904430 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-25ca9d2b-316e-4707-b140-eee52fc76c9d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:44.905133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-25ca9d2b-316e-4707-b140-eee52fc76c9d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:44.912070 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25ca9d2b-316e-4707-b140-eee52fc76c9d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:44.912564 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25ca9d2b-316e-4707-b140-eee52fc76c9d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:44.913015 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25ca9d2b-316e-4707-b140-eee52fc76c9d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:44.913771 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25ca9d2b-316e-4707-b140-eee52fc76c9d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:44.914234 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25ca9d2b-316e-4707-b140-eee52fc76c9d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:44.914664 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-25ca9d2b-316e-4707-b140-eee52fc76c9d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:45.074656 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-25ca9d2b-316e-4707-b140-eee52fc76c9d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:45.083614 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-25ca9d2b-316e-4707-b140-eee52fc76c9d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:45.085044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-25ca9d2b-316e-4707-b140-eee52fc76c9d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:45.086201 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-25ca9d2b-316e-4707-b140-eee52fc76c9d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1716 microversion: 2.20 time: 0.186732 Aug 29 19:12:45.086761 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 476/958] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:44 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1716 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:51.961188 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7c074f17-beef-4438-8701-104719a27082 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:51.963459 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7c074f17-beef-4438-8701-104719a27082 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:51.970116 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c074f17-beef-4438-8701-104719a27082 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:51.970589 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c074f17-beef-4438-8701-104719a27082 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:51.971044 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c074f17-beef-4438-8701-104719a27082 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:51.972358 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c074f17-beef-4438-8701-104719a27082 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:51.972806 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c074f17-beef-4438-8701-104719a27082 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:51.973224 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c074f17-beef-4438-8701-104719a27082 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:52.002075 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7c074f17-beef-4438-8701-104719a27082 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044774 Aug 29 19:12:52.002643 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 483/959] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:12:51 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:52.157752 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1a301239-4cc3-4d42-bb5f-69badae716ce tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:52.158301 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1a301239-4cc3-4d42-bb5f-69badae716ce tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:52.164587 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a301239-4cc3-4d42-bb5f-69badae716ce tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:52.165071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a301239-4cc3-4d42-bb5f-69badae716ce tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:52.165505 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a301239-4cc3-4d42-bb5f-69badae716ce tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:52.166188 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a301239-4cc3-4d42-bb5f-69badae716ce tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:52.166640 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a301239-4cc3-4d42-bb5f-69badae716ce tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:52.167095 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a301239-4cc3-4d42-bb5f-69badae716ce tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:52.196866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1a301239-4cc3-4d42-bb5f-69badae716ce tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments/e13b6b9b-c815-49db-b2f4-41a9d2fc88a3" status: 200 len: 194 microversion: 2.1 time: 0.043076 Aug 29 19:12:52.197362 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 477/960] 10.222.0.86 () {58 vars in 1413 bytes} [Mon Aug 29 19:12:52 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments/e13b6b9b-c815-49db-b2f4-41a9d2fc88a3 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:52.208409 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4cc5e9fa-a795-4cbe-8a36-c63f84969c0c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:52.208914 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4cc5e9fa-a795-4cbe-8a36-c63f84969c0c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:52.214752 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4cc5e9fa-a795-4cbe-8a36-c63f84969c0c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:52.215278 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4cc5e9fa-a795-4cbe-8a36-c63f84969c0c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:52.215716 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4cc5e9fa-a795-4cbe-8a36-c63f84969c0c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:52.216406 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4cc5e9fa-a795-4cbe-8a36-c63f84969c0c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:52.216866 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4cc5e9fa-a795-4cbe-8a36-c63f84969c0c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:52.217289 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4cc5e9fa-a795-4cbe-8a36-c63f84969c0c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:52.301566 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-4cc5e9fa-a795-4cbe-8a36-c63f84969c0c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lazy-loading 'services' on Instance uuid 81db0eba-3d09-45c7-bf0a-143e09b8b69d {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:12:52.373441 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4cc5e9fa-a795-4cbe-8a36-c63f84969c0c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "DELETE /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments/e13b6b9b-c815-49db-b2f4-41a9d2fc88a3" status: 202 len: 0 microversion: 2.1 time: 0.169408 Aug 29 19:12:52.374013 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 484/961] 10.222.0.86 () {58 vars in 1416 bytes} [Mon Aug 29 19:12:52 2022] DELETE /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments/e13b6b9b-c815-49db-b2f4-41a9d2fc88a3 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:12:54.557450 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b5d41c8f-3eea-4349-9878-99aa5b7ca30d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:54.557945 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b5d41c8f-3eea-4349-9878-99aa5b7ca30d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:54.564384 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5d41c8f-3eea-4349-9878-99aa5b7ca30d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:54.564866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5d41c8f-3eea-4349-9878-99aa5b7ca30d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:54.565792 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5d41c8f-3eea-4349-9878-99aa5b7ca30d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:54.566479 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5d41c8f-3eea-4349-9878-99aa5b7ca30d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:54.566930 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5d41c8f-3eea-4349-9878-99aa5b7ca30d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:54.567378 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5d41c8f-3eea-4349-9878-99aa5b7ca30d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:54.596248 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b5d41c8f-3eea-4349-9878-99aa5b7ca30d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments/a649f8fa-1458-4b21-8f0a-a4e414056e29" status: 200 len: 194 microversion: 2.1 time: 0.042828 Aug 29 19:12:54.596819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 478/962] 10.222.0.86 () {58 vars in 1413 bytes} [Mon Aug 29 19:12:54 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments/a649f8fa-1458-4b21-8f0a-a4e414056e29 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:54.608035 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ab0f1b3a-3266-4e64-a8ef-b22d99be3db5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:54.608617 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ab0f1b3a-3266-4e64-a8ef-b22d99be3db5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:54.614756 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab0f1b3a-3266-4e64-a8ef-b22d99be3db5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:54.615273 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab0f1b3a-3266-4e64-a8ef-b22d99be3db5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:54.615708 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab0f1b3a-3266-4e64-a8ef-b22d99be3db5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:54.616386 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab0f1b3a-3266-4e64-a8ef-b22d99be3db5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:54.616836 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab0f1b3a-3266-4e64-a8ef-b22d99be3db5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:54.617255 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab0f1b3a-3266-4e64-a8ef-b22d99be3db5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:54.697128 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-ab0f1b3a-3266-4e64-a8ef-b22d99be3db5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lazy-loading 'services' on Instance uuid 81db0eba-3d09-45c7-bf0a-143e09b8b69d {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:12:54.767650 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ab0f1b3a-3266-4e64-a8ef-b22d99be3db5 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "DELETE /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments/a649f8fa-1458-4b21-8f0a-a4e414056e29" status: 202 len: 0 microversion: 2.1 time: 0.164200 Aug 29 19:12:54.768258 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 485/963] 10.222.0.86 () {58 vars in 1416 bytes} [Mon Aug 29 19:12:54 2022] DELETE /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments/a649f8fa-1458-4b21-8f0a-a4e414056e29 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:12:56.994643 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a6b92a02-b83a-45da-9d00-0dca548e9a48 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:56.996861 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a6b92a02-b83a-45da-9d00-0dca548e9a48 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:57.003188 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6b92a02-b83a-45da-9d00-0dca548e9a48 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:57.003664 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6b92a02-b83a-45da-9d00-0dca548e9a48 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:57.004082 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6b92a02-b83a-45da-9d00-0dca548e9a48 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:57.004764 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6b92a02-b83a-45da-9d00-0dca548e9a48 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:57.005207 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6b92a02-b83a-45da-9d00-0dca548e9a48 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:57.005624 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a6b92a02-b83a-45da-9d00-0dca548e9a48 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:57.034735 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a6b92a02-b83a-45da-9d00-0dca548e9a48 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043337 Aug 29 19:12:57.035303 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 479/964] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:12:56 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:12:57.147719 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3c8d45f2-1ccb-466b-9a16-66bfc1f1eca3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:57.150022 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3c8d45f2-1ccb-466b-9a16-66bfc1f1eca3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:57.156109 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c8d45f2-1ccb-466b-9a16-66bfc1f1eca3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:57.156592 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c8d45f2-1ccb-466b-9a16-66bfc1f1eca3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:57.157030 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c8d45f2-1ccb-466b-9a16-66bfc1f1eca3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:57.157717 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c8d45f2-1ccb-466b-9a16-66bfc1f1eca3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:57.158169 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c8d45f2-1ccb-466b-9a16-66bfc1f1eca3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:57.158591 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c8d45f2-1ccb-466b-9a16-66bfc1f1eca3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:57.188087 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3c8d45f2-1ccb-466b-9a16-66bfc1f1eca3 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045645 Aug 29 19:12:57.188629 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 486/965] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:12:57 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:12:57.249048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c3fdad96-4771-4113-b44c-12bc8ca8c43b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:57.249544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c3fdad96-4771-4113-b44c-12bc8ca8c43b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:57.255451 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3fdad96-4771-4113-b44c-12bc8ca8c43b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:57.255935 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3fdad96-4771-4113-b44c-12bc8ca8c43b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:57.256366 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3fdad96-4771-4113-b44c-12bc8ca8c43b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:57.257047 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3fdad96-4771-4113-b44c-12bc8ca8c43b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:57.257491 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3fdad96-4771-4113-b44c-12bc8ca8c43b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:57.257907 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3fdad96-4771-4113-b44c-12bc8ca8c43b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:57.282780 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c3fdad96-4771-4113-b44c-12bc8ca8c43b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:12:57.356887 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c3fdad96-4771-4113-b44c-12bc8ca8c43b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "DELETE /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 204 len: 0 microversion: 2.1 time: 0.111337 Aug 29 19:12:57.357671 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 480/966] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:12:57 2022] DELETE /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:12:57.365703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a1a664dc-e668-4682-8c03-adff22c0467d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:57.366326 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a1a664dc-e668-4682-8c03-adff22c0467d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:57.372190 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1a664dc-e668-4682-8c03-adff22c0467d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:57.372670 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1a664dc-e668-4682-8c03-adff22c0467d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:57.373103 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1a664dc-e668-4682-8c03-adff22c0467d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:57.373781 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1a664dc-e668-4682-8c03-adff22c0467d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:57.374230 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1a664dc-e668-4682-8c03-adff22c0467d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:57.374649 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1a664dc-e668-4682-8c03-adff22c0467d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:57.507931 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a1a664dc-e668-4682-8c03-adff22c0467d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:57.517916 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a1a664dc-e668-4682-8c03-adff22c0467d tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 200 len: 1674 microversion: 2.1 time: 0.156111 Aug 29 19:12:57.519583 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 487/967] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:57 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:58.541725 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-12ddb635-a1f1-44c2-942d-795fc403a4fb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:58.542424 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-12ddb635-a1f1-44c2-942d-795fc403a4fb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:58.544795 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:58.550133 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12ddb635-a1f1-44c2-942d-795fc403a4fb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:58.550617 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12ddb635-a1f1-44c2-942d-795fc403a4fb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:58.551074 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12ddb635-a1f1-44c2-942d-795fc403a4fb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:58.551768 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12ddb635-a1f1-44c2-942d-795fc403a4fb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:58.552222 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12ddb635-a1f1-44c2-942d-795fc403a4fb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:58.552675 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12ddb635-a1f1-44c2-942d-795fc403a4fb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:58.682949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-12ddb635-a1f1-44c2-942d-795fc403a4fb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:58.693197 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-12ddb635-a1f1-44c2-942d-795fc403a4fb tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 200 len: 1674 microversion: 2.1 time: 0.156118 Aug 29 19:12:58.693775 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 481/968] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:58 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:59.714857 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ab72fa55-805c-496e-a3f7-c125b24d79a9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:59.715534 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ab72fa55-805c-496e-a3f7-c125b24d79a9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:59.717898 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=42 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:59.723228 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab72fa55-805c-496e-a3f7-c125b24d79a9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:59.723707 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab72fa55-805c-496e-a3f7-c125b24d79a9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:59.724138 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab72fa55-805c-496e-a3f7-c125b24d79a9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:59.724817 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab72fa55-805c-496e-a3f7-c125b24d79a9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:59.725265 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab72fa55-805c-496e-a3f7-c125b24d79a9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:59.725682 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab72fa55-805c-496e-a3f7-c125b24d79a9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:59.858024 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ab72fa55-805c-496e-a3f7-c125b24d79a9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:59.865642 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ab72fa55-805c-496e-a3f7-c125b24d79a9 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 200 len: 1674 microversion: 2.1 time: 0.154594 Aug 29 19:12:59.866203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 488/969] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:59 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:00.887822 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0e9ff0d6-034f-45c7-b2c1-8385a98f176c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:00.888476 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0e9ff0d6-034f-45c7-b2c1-8385a98f176c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:00.894973 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0e9ff0d6-034f-45c7-b2c1-8385a98f176c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:00.895486 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0e9ff0d6-034f-45c7-b2c1-8385a98f176c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:00.895923 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0e9ff0d6-034f-45c7-b2c1-8385a98f176c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:00.896618 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0e9ff0d6-034f-45c7-b2c1-8385a98f176c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:00.897058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0e9ff0d6-034f-45c7-b2c1-8385a98f176c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:00.897475 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0e9ff0d6-034f-45c7-b2c1-8385a98f176c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:00.981135 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0e9ff0d6-034f-45c7-b2c1-8385a98f176c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b114570010d94eea955b7b3f1fa97c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c146a9d54f4ed0a4e8a4a835d6367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:00.989630 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0e9ff0d6-034f-45c7-b2c1-8385a98f176c tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 200 len: 1606 microversion: 2.1 time: 0.105576 Aug 29 19:13:00.990264 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 482/970] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:00 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 1606 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:01.094573 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-acc3fa62-74a2-4926-b3ae-306223651e1a req-b900c68a-0806-4296-b4d1-3f72861fc8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81db0eba-3d09-45c7-bf0a-143e09b8b69d", "name": "network-vif-deleted", "tag": "0df5eb8e-bdb7-4ec2-b414-5ce238d4948d"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:01.109280 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-acc3fa62-74a2-4926-b3ae-306223651e1a req-b900c68a-0806-4296-b4d1-3f72861fc8cf service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:01.109832 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-acc3fa62-74a2-4926-b3ae-306223651e1a req-b900c68a-0806-4296-b4d1-3f72861fc8cf service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:01.110185 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-acc3fa62-74a2-4926-b3ae-306223651e1a req-b900c68a-0806-4296-b4d1-3f72861fc8cf service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:01.125034 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-acc3fa62-74a2-4926-b3ae-306223651e1a req-b900c68a-0806-4296-b4d1-3f72861fc8cf service nova] Creating event network-vif-deleted:0df5eb8e-bdb7-4ec2-b414-5ce238d4948d for instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d on hv-cinder-85083 Aug 29 19:13:01.129971 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-acc3fa62-74a2-4926-b3ae-306223651e1a req-b900c68a-0806-4296-b4d1-3f72861fc8cf service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039113 Aug 29 19:13:01.130631 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 489/971] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:02.012286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-84fd8cac-6d78-4299-b792-f01c878f8219 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:02.012972 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-84fd8cac-6d78-4299-b792-f01c878f8219 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:02.019682 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84fd8cac-6d78-4299-b792-f01c878f8219 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:02.020180 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84fd8cac-6d78-4299-b792-f01c878f8219 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:02.020622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84fd8cac-6d78-4299-b792-f01c878f8219 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:02.021331 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84fd8cac-6d78-4299-b792-f01c878f8219 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:02.021946 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84fd8cac-6d78-4299-b792-f01c878f8219 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:02.022377 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84fd8cac-6d78-4299-b792-f01c878f8219 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:02.037254 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-84fd8cac-6d78-4299-b792-f01c878f8219 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] HTTP exception thrown: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-84fd8cac-6d78-4299-b792-f01c878f8219 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Request method failure captured: Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d HTTP/1.1 Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0flrQm6vNrR-1XPxHS3YIeqRr-zQnpSsObnBMg78QkOkdnuP2tj3QTnx8AkbA5-p1ypfdNP5Jb7Tj4FW2i1Rx72GZVXa1OOc9LSvu2jr2iDubgD86MX0gxM_FS88G2VZgN4W-E_Fo_W_B81GfBD5EL2euYYnSP6aNqInSk5WienCY Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 12c146a9d54f4ed0a4e8a4a835d6367f Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:13:02.039136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:13:02.040690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_12c146a9d54f4ed0a4e8a4a835d6367f"}]}] Aug 29 19:13:02.040690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:13:02.040690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 12c146a9d54f4ed0a4e8a4a835d6367f Aug 29 19:13:02.040690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:13:02.040690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeTestJSON-817037756-project Aug 29 19:13:02.040690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:13:02.040690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:13:02.040690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: b114570010d94eea955b7b3f1fa97c0a Aug 29 19:13:02.040690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeTestJSON-817037756-project Aug 29 19:13:02.040690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:13:02.040690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. Aug 29 19:13:02.040690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': '81db0eba-3d09-45c7-bf0a-143e09b8b69d'} Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:13:02.041492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. Aug 29 19:13:02.042804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:13:02.044016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-84fd8cac-6d78-4299-b792-f01c878f8219 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Returning 404 to user: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:13:02.044016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-84fd8cac-6d78-4299-b792-f01c878f8219 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 404 len: 111 microversion: 2.1 time: 0.033194 Aug 29 19:13:02.044999 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 483/972] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:02 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:13:02.052033 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d5d847b3-66d7-49a4-8f05-184c203b5aca tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '.version_select at 0x7fb2b9d328b0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:02.056800 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d5d847b3-66d7-49a4-8f05-184c203b5aca tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [217d221d-a67f-4c5e-995b-b4d98e0eed34] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 19:13:03.063543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO oslo.messaging._drivers.impl_rabbit [None req-d5d847b3-66d7-49a4-8f05-184c203b5aca tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [217d221d-a67f-4c5e-995b-b4d98e0eed34] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 44526. Aug 29 19:13:03.082492 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d5d847b3-66d7-49a4-8f05-184c203b5aca tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-846177093" status: 202 len: 0 microversion: 2.1 time: 1.036071 Aug 29 19:13:03.083102 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 490/973] 10.222.0.86 () {58 vars in 1218 bytes} [Mon Aug 29 19:13:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-846177093 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:13:05.957987 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-84fc9974-dbd3-439d-aac3-3fe538349461 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:05.958492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-84fc9974-dbd3-439d-aac3-3fe538349461 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:05.964921 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84fc9974-dbd3-439d-aac3-3fe538349461 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:05.965426 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84fc9974-dbd3-439d-aac3-3fe538349461 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:05.965855 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84fc9974-dbd3-439d-aac3-3fe538349461 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:05.966532 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84fc9974-dbd3-439d-aac3-3fe538349461 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:05.966976 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84fc9974-dbd3-439d-aac3-3fe538349461 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:05.967414 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-84fc9974-dbd3-439d-aac3-3fe538349461 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:05.971872 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:05.982659 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-84fc9974-dbd3-439d-aac3-3fe538349461 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] HTTP exception thrown: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-84fc9974-dbd3-439d-aac3-3fe538349461 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Request method failure captured: Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: DELETE /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d HTTP/1.1 Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0flrQm6vNrR-1XPxHS3YIeqRr-zQnpSsObnBMg78QkOkdnuP2tj3QTnx8AkbA5-p1ypfdNP5Jb7Tj4FW2i1Rx72GZVXa1OOc9LSvu2jr2iDubgD86MX0gxM_FS88G2VZgN4W-E_Fo_W_B81GfBD5EL2euYYnSP6aNqInSk5WienCY Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 12c146a9d54f4ed0a4e8a4a835d6367f Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:13:05.984392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:13:05.985956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_12c146a9d54f4ed0a4e8a4a835d6367f"}]}] Aug 29 19:13:05.985956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:13:05.985956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 12c146a9d54f4ed0a4e8a4a835d6367f Aug 29 19:13:05.985956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:13:05.985956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeTestJSON-817037756-project Aug 29 19:13:05.985956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:13:05.985956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:13:05.985956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: b114570010d94eea955b7b3f1fa97c0a Aug 29 19:13:05.985956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeTestJSON-817037756-project Aug 29 19:13:05.985956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:13:05.985956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. Aug 29 19:13:05.985956 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': '81db0eba-3d09-45c7-bf0a-143e09b8b69d'} Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:13:05.986879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. Aug 29 19:13:05.988345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:13:05.989810 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-84fc9974-dbd3-439d-aac3-3fe538349461 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Returning 404 to user: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:13:05.989810 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-84fc9974-dbd3-439d-aac3-3fe538349461 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "DELETE /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 404 len: 111 microversion: 2.1 time: 0.032424 Aug 29 19:13:05.989810 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 484/974] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:13:05 2022] DELETE /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:13:05.994824 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-941cc9da-f719-4f24-b7f0-2e7aa2acb318 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:05.995577 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-941cc9da-f719-4f24-b7f0-2e7aa2acb318 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 81db0eba-3d09-45c7-bf0a-143e09b8b69d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:06.002115 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-941cc9da-f719-4f24-b7f0-2e7aa2acb318 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:06.002594 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-941cc9da-f719-4f24-b7f0-2e7aa2acb318 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:06.003047 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-941cc9da-f719-4f24-b7f0-2e7aa2acb318 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:06.003734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-941cc9da-f719-4f24-b7f0-2e7aa2acb318 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:06.004183 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-941cc9da-f719-4f24-b7f0-2e7aa2acb318 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:06.004603 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-941cc9da-f719-4f24-b7f0-2e7aa2acb318 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:06.017188 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-941cc9da-f719-4f24-b7f0-2e7aa2acb318 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] HTTP exception thrown: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-941cc9da-f719-4f24-b7f0-2e7aa2acb318 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Request method failure captured: Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d HTTP/1.1 Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ0flrQm6vNrR-1XPxHS3YIeqRr-zQnpSsObnBMg78QkOkdnuP2tj3QTnx8AkbA5-p1ypfdNP5Jb7Tj4FW2i1Rx72GZVXa1OOc9LSvu2jr2iDubgD86MX0gxM_FS88G2VZgN4W-E_Fo_W_B81GfBD5EL2euYYnSP6aNqInSk5WienCY Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: 12c146a9d54f4ed0a4e8a4a835d6367f Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:13:06.019311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:13:06.021003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_12c146a9d54f4ed0a4e8a4a835d6367f"}]}] Aug 29 19:13:06.021003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:13:06.021003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 12c146a9d54f4ed0a4e8a4a835d6367f Aug 29 19:13:06.021003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:13:06.021003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeTestJSON-817037756-project Aug 29 19:13:06.021003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:13:06.021003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:13:06.021003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: b114570010d94eea955b7b3f1fa97c0a Aug 29 19:13:06.021003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeTestJSON-817037756-project Aug 29 19:13:06.021003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:13:06.021003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. Aug 29 19:13:06.021003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': '81db0eba-3d09-45c7-bf0a-143e09b8b69d'} Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:13:06.021927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. Aug 29 19:13:06.023497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:13:06.024795 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-941cc9da-f719-4f24-b7f0-2e7aa2acb318 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Returning 404 to user: Instance 81db0eba-3d09-45c7-bf0a-143e09b8b69d could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:13:06.024795 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-941cc9da-f719-4f24-b7f0-2e7aa2acb318 tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d" status: 404 len: 111 microversion: 2.1 time: 0.030120 Aug 29 19:13:06.024795 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 491/975] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:05 2022] GET /compute/v2.1/servers/81db0eba-3d09-45c7-bf0a-143e09b8b69d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:13:07.156720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8421262b-5ffb-48f1-883f-b3625787096a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:07.157222 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8421262b-5ffb-48f1-883f-b3625787096a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:07.165670 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8421262b-5ffb-48f1-883f-b3625787096a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:07.166157 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8421262b-5ffb-48f1-883f-b3625787096a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:07.166595 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8421262b-5ffb-48f1-883f-b3625787096a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:07.167317 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8421262b-5ffb-48f1-883f-b3625787096a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:07.167773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8421262b-5ffb-48f1-883f-b3625787096a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:07.168200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8421262b-5ffb-48f1-883f-b3625787096a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:07.183473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-8421262b-5ffb-48f1-883f-b3625787096a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] HTTP exception thrown: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8421262b-5ffb-48f1-883f-b3625787096a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Request method failure captured: Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: DELETE /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 HTTP/1.1 Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0flrQm6vNrR-1XPxHS3YIeqRr-zQnpSsObnBMg78QkOkdnuP2tj3QTnx8AkbA5-p1ypfdNP5Jb7Tj4FW2i1Rx72GZVXa1OOc9LSvu2jr2iDubgD86MX0gxM_FS88G2VZgN4W-E_Fo_W_B81GfBD5EL2euYYnSP6aNqInSk5WienCY Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 12c146a9d54f4ed0a4e8a4a835d6367f Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:13:07.185048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:13:07.186594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_12c146a9d54f4ed0a4e8a4a835d6367f"}]}] Aug 29 19:13:07.186594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:13:07.186594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 12c146a9d54f4ed0a4e8a4a835d6367f Aug 29 19:13:07.186594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:13:07.186594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeTestJSON-817037756-project Aug 29 19:13:07.186594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:13:07.186594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:13:07.186594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: b114570010d94eea955b7b3f1fa97c0a Aug 29 19:13:07.186594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeTestJSON-817037756-project Aug 29 19:13:07.186594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:13:07.186594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. Aug 29 19:13:07.186594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': '4429ad44-4714-483b-b5b3-0091aabe6905'} Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:13:07.187502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. Aug 29 19:13:07.188965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:13:07.190414 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8421262b-5ffb-48f1-883f-b3625787096a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Returning 404 to user: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:13:07.190414 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8421262b-5ffb-48f1-883f-b3625787096a tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "DELETE /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 404 len: 111 microversion: 2.1 time: 0.034093 Aug 29 19:13:07.190414 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 485/976] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:13:07 2022] DELETE /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:13:07.194922 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-14666ce3-22ea-448f-ad3c-6b40ab877f6b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:07.195655 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-14666ce3-22ea-448f-ad3c-6b40ab877f6b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] [instance: 4429ad44-4714-483b-b5b3-0091aabe6905] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:07.202388 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14666ce3-22ea-448f-ad3c-6b40ab877f6b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:07.202873 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14666ce3-22ea-448f-ad3c-6b40ab877f6b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:07.203326 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14666ce3-22ea-448f-ad3c-6b40ab877f6b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:07.204014 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14666ce3-22ea-448f-ad3c-6b40ab877f6b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:07.204466 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14666ce3-22ea-448f-ad3c-6b40ab877f6b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:07.204883 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14666ce3-22ea-448f-ad3c-6b40ab877f6b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:07.219238 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-14666ce3-22ea-448f-ad3c-6b40ab877f6b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] HTTP exception thrown: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-14666ce3-22ea-448f-ad3c-6b40ab877f6b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Request method failure captured: Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 HTTP/1.1 Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ0flrQm6vNrR-1XPxHS3YIeqRr-zQnpSsObnBMg78QkOkdnuP2tj3QTnx8AkbA5-p1ypfdNP5Jb7Tj4FW2i1Rx72GZVXa1OOc9LSvu2jr2iDubgD86MX0gxM_FS88G2VZgN4W-E_Fo_W_B81GfBD5EL2euYYnSP6aNqInSk5WienCY Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: 12c146a9d54f4ed0a4e8a4a835d6367f Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:13:07.220739 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:13:07.222789 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/12c146a9d54f4ed0a4e8a4a835d6367f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_12c146a9d54f4ed0a4e8a4a835d6367f"}]}] Aug 29 19:13:07.222789 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:13:07.222789 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 12c146a9d54f4ed0a4e8a4a835d6367f Aug 29 19:13:07.222789 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeTestJSON-817037756 Aug 29 19:13:07.222789 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeTestJSON-817037756-project Aug 29 19:13:07.222789 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:13:07.222789 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:13:07.222789 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: b114570010d94eea955b7b3f1fa97c0a Aug 29 19:13:07.222789 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeTestJSON-817037756-project Aug 29 19:13:07.222789 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:13:07.222789 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. Aug 29 19:13:07.222789 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': '4429ad44-4714-483b-b5b3-0091aabe6905'} Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:13:07.223657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. Aug 29 19:13:07.224863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:13:07.225940 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-14666ce3-22ea-448f-ad3c-6b40ab877f6b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] Returning 404 to user: Instance 4429ad44-4714-483b-b5b3-0091aabe6905 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:13:07.225940 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-14666ce3-22ea-448f-ad3c-6b40ab877f6b tempest-AttachVolumeTestJSON-817037756 tempest-AttachVolumeTestJSON-817037756-project] 10.222.0.86 "GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905" status: 404 len: 111 microversion: 2.1 time: 0.031448 Aug 29 19:13:07.225940 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 492/977] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:07 2022] GET /compute/v2.1/servers/4429ad44-4714-483b-b5b3-0091aabe6905 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:13:16.302841 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cf249761-f628-415a-8271-7586a51eb1dd tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Action: 'create', calling method: .version_select at 0x7fb2b9e16a60>, body: {"keypair": {"name": "tempest-keypair-559755597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP46X1fWMEvOtaF2CiM3q5W8gEdtcKO8bBQh9+Ve402Y24httmxVZTrGRPHnz0cymig2+7N8Z2eu0+uLcPWamXicEVAT3FLZZ9qBUnRl1le0TfWKtdniQ5XEZj39Qz+n2g=="}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:16.319238 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-cf249761-f628-415a-8271-7586a51eb1dd tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Getting quotas for project fe9fc68075be4712a305fb8a15c91f19. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:13:16.323325 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-cf249761-f628-415a-8271-7586a51eb1dd tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Getting quotas for user a982dbba4a324a4f893e427000ce9b93 and project fe9fc68075be4712a305fb8a15c91f19. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:13:16.346542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-cf249761-f628-415a-8271-7586a51eb1dd tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.177306 Aug 29 19:13:16.347529 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 486/978] 10.222.0.86 () {60 vars in 1159 bytes} [Mon Aug 29 19:13:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:17.591741 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-199067221", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c198086-2b12-4afa-9f22-a31dfbf52cb2"}], "security_groups": [{"name": "tempest-securitygroup--2042578511"}], "key_name": "tempest-keypair-559755597", "user_data": "}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:17.601905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:17.602836 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:17.708919 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] validate_networks() for [('2c198086-2b12-4afa-9f22-a31dfbf52cb2', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:13:18.094673 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:13:18.095133 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:13:18.095614 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:13:18.096718 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:13:18.097455 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:13:18.108404 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:18.108896 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:18.109530 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:18.110277 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:18.110736 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:18.111198 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:18.127931 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Getting quotas for project fe9fc68075be4712a305fb8a15c91f19. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:13:18.131955 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Getting quotas for user a982dbba4a324a4f893e427000ce9b93 and project fe9fc68075be4712a305fb8a15c91f19. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:13:18.144554 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:13:18.146868 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:13:18.195745 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ceb315d7-8cf9-453b-bd64-cdcffd208735 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.608357 Aug 29 19:13:18.202621 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 493/979] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:13:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:13:18.208965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0a1dee7e-7b4c-4557-9b35-f3f456aed1a0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:18.209588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0a1dee7e-7b4c-4557-9b35-f3f456aed1a0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:18.211727 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:18.279820 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0a1dee7e-7b4c-4557-9b35-f3f456aed1a0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:18.287756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0a1dee7e-7b4c-4557-9b35-f3f456aed1a0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 200 len: 1240 microversion: 2.1 time: 0.083706 Aug 29 19:13:18.288510 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 487/980] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:18 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:19.308421 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fc1db28e-ce0b-4452-9f27-0261e481bc1a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:19.309037 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fc1db28e-ce0b-4452-9f27-0261e481bc1a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:19.316760 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc1db28e-ce0b-4452-9f27-0261e481bc1a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:19.317240 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc1db28e-ce0b-4452-9f27-0261e481bc1a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:19.317671 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc1db28e-ce0b-4452-9f27-0261e481bc1a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:19.318450 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc1db28e-ce0b-4452-9f27-0261e481bc1a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:19.318793 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc1db28e-ce0b-4452-9f27-0261e481bc1a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:19.319243 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc1db28e-ce0b-4452-9f27-0261e481bc1a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:19.392077 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fc1db28e-ce0b-4452-9f27-0261e481bc1a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:19.400608 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fc1db28e-ce0b-4452-9f27-0261e481bc1a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 200 len: 1292 microversion: 2.1 time: 0.096135 Aug 29 19:13:19.401166 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 494/981] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:19 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:20.427662 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6a06f8dc-8c58-4a3d-b0f3-93a68f12e034 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:20.428226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6a06f8dc-8c58-4a3d-b0f3-93a68f12e034 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:20.435401 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a06f8dc-8c58-4a3d-b0f3-93a68f12e034 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:20.436094 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a06f8dc-8c58-4a3d-b0f3-93a68f12e034 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:20.436692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a06f8dc-8c58-4a3d-b0f3-93a68f12e034 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:20.437575 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a06f8dc-8c58-4a3d-b0f3-93a68f12e034 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:20.438184 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a06f8dc-8c58-4a3d-b0f3-93a68f12e034 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:20.438821 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a06f8dc-8c58-4a3d-b0f3-93a68f12e034 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:20.661038 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6a06f8dc-8c58-4a3d-b0f3-93a68f12e034 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:20.668626 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6a06f8dc-8c58-4a3d-b0f3-93a68f12e034 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 200 len: 1366 microversion: 2.1 time: 0.245880 Aug 29 19:13:20.669209 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 488/982] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:20 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:20.957321 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-9e9b30e0-9653-41b6-9d22-c39b3f28767b req-50322827-1a32-4eac-bedb-80dc1fe1eceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8f7dba-a886-4ceb-815a-9c877abfd96d", "tag": "942d1592-aedb-4c4c-b557-2e53b2a12a6b"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:20.974114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-9e9b30e0-9653-41b6-9d22-c39b3f28767b req-50322827-1a32-4eac-bedb-80dc1fe1eceb service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:20.974678 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-9e9b30e0-9653-41b6-9d22-c39b3f28767b req-50322827-1a32-4eac-bedb-80dc1fe1eceb service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:20.975164 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-9e9b30e0-9653-41b6-9d22-c39b3f28767b req-50322827-1a32-4eac-bedb-80dc1fe1eceb service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:20.986162 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-9e9b30e0-9653-41b6-9d22-c39b3f28767b req-50322827-1a32-4eac-bedb-80dc1fe1eceb service nova] Creating event network-changed:942d1592-aedb-4c4c-b557-2e53b2a12a6b for instance df8f7dba-a886-4ceb-815a-9c877abfd96d on hv-cinder-85083 Aug 29 19:13:20.991678 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-9e9b30e0-9653-41b6-9d22-c39b3f28767b req-50322827-1a32-4eac-bedb-80dc1fe1eceb service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038660 Aug 29 19:13:20.992265 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 495/983] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:21.689950 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fd07b10a-6a03-4903-801b-bb2d4e7e3ca3 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:21.690327 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fd07b10a-6a03-4903-801b-bb2d4e7e3ca3 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:21.696640 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd07b10a-6a03-4903-801b-bb2d4e7e3ca3 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:21.697118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd07b10a-6a03-4903-801b-bb2d4e7e3ca3 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:21.697547 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd07b10a-6a03-4903-801b-bb2d4e7e3ca3 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:21.698228 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd07b10a-6a03-4903-801b-bb2d4e7e3ca3 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:21.698674 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd07b10a-6a03-4903-801b-bb2d4e7e3ca3 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:21.699118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd07b10a-6a03-4903-801b-bb2d4e7e3ca3 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:21.828214 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fd07b10a-6a03-4903-801b-bb2d4e7e3ca3 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:21.836467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fd07b10a-6a03-4903-801b-bb2d4e7e3ca3 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 200 len: 1366 microversion: 2.1 time: 0.150736 Aug 29 19:13:21.837021 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 489/984] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:21 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:22.858590 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ca148cda-9d5a-4b10-9425-ac5680a2e1c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:22.859312 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ca148cda-9d5a-4b10-9425-ac5680a2e1c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:22.866083 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ca148cda-9d5a-4b10-9425-ac5680a2e1c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:22.866564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ca148cda-9d5a-4b10-9425-ac5680a2e1c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:22.867016 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ca148cda-9d5a-4b10-9425-ac5680a2e1c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:22.867700 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ca148cda-9d5a-4b10-9425-ac5680a2e1c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:22.868149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ca148cda-9d5a-4b10-9425-ac5680a2e1c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:22.868570 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ca148cda-9d5a-4b10-9425-ac5680a2e1c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:22.999816 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ca148cda-9d5a-4b10-9425-ac5680a2e1c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:23.007439 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ca148cda-9d5a-4b10-9425-ac5680a2e1c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 200 len: 1366 microversion: 2.1 time: 0.153526 Aug 29 19:13:23.007987 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 496/985] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:22 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:24.028232 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-47c71e2b-7165-44a3-af93-07d1c790b644 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:24.028842 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-47c71e2b-7165-44a3-af93-07d1c790b644 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:24.035276 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47c71e2b-7165-44a3-af93-07d1c790b644 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:24.035760 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47c71e2b-7165-44a3-af93-07d1c790b644 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:24.036194 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47c71e2b-7165-44a3-af93-07d1c790b644 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:24.036881 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47c71e2b-7165-44a3-af93-07d1c790b644 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:24.037339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47c71e2b-7165-44a3-af93-07d1c790b644 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:24.037764 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-47c71e2b-7165-44a3-af93-07d1c790b644 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:24.165251 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-47c71e2b-7165-44a3-af93-07d1c790b644 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:24.172810 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-47c71e2b-7165-44a3-af93-07d1c790b644 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 200 len: 1366 microversion: 2.1 time: 0.148808 Aug 29 19:13:24.173367 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 490/986] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:24 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:25.194820 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0e641288-d459-4e3d-abe4-923646528ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:25.195415 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0e641288-d459-4e3d-abe4-923646528ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:25.202053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e641288-d459-4e3d-abe4-923646528ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:25.202531 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e641288-d459-4e3d-abe4-923646528ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:25.202961 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e641288-d459-4e3d-abe4-923646528ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:25.203673 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e641288-d459-4e3d-abe4-923646528ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:25.204121 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e641288-d459-4e3d-abe4-923646528ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:25.204542 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e641288-d459-4e3d-abe4-923646528ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:25.334620 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0e641288-d459-4e3d-abe4-923646528ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:25.342424 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0e641288-d459-4e3d-abe4-923646528ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 200 len: 1366 microversion: 2.1 time: 0.151584 Aug 29 19:13:25.343009 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 497/987] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:25 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:26.363644 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f0fb47b5-8f2c-46e3-904a-4e42dd8769a8 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:26.364245 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f0fb47b5-8f2c-46e3-904a-4e42dd8769a8 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:26.370696 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0fb47b5-8f2c-46e3-904a-4e42dd8769a8 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:26.371215 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0fb47b5-8f2c-46e3-904a-4e42dd8769a8 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:26.371643 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0fb47b5-8f2c-46e3-904a-4e42dd8769a8 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:26.372327 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0fb47b5-8f2c-46e3-904a-4e42dd8769a8 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:26.372773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0fb47b5-8f2c-46e3-904a-4e42dd8769a8 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:26.373192 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0fb47b5-8f2c-46e3-904a-4e42dd8769a8 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:26.505925 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f0fb47b5-8f2c-46e3-904a-4e42dd8769a8 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:26.513637 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f0fb47b5-8f2c-46e3-904a-4e42dd8769a8 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 200 len: 1366 microversion: 2.1 time: 0.154286 Aug 29 19:13:26.514363 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 491/988] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:26 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:26.939394 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-7f17dae4-a361-43ea-8d21-1a2e3f38edbb req-8bf688aa-126a-443a-b38e-949ef3a5b4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8f7dba-a886-4ceb-815a-9c877abfd96d", "name": "network-vif-plugged", "status": "completed", "tag": "942d1592-aedb-4c4c-b557-2e53b2a12a6b"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:26.949693 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-7f17dae4-a361-43ea-8d21-1a2e3f38edbb req-8bf688aa-126a-443a-b38e-949ef3a5b4fd service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:26.950436 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-7f17dae4-a361-43ea-8d21-1a2e3f38edbb req-8bf688aa-126a-443a-b38e-949ef3a5b4fd service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:26.950866 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-7f17dae4-a361-43ea-8d21-1a2e3f38edbb req-8bf688aa-126a-443a-b38e-949ef3a5b4fd service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:26.962426 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-7f17dae4-a361-43ea-8d21-1a2e3f38edbb req-8bf688aa-126a-443a-b38e-949ef3a5b4fd service nova] Creating event network-vif-plugged:942d1592-aedb-4c4c-b557-2e53b2a12a6b for instance df8f7dba-a886-4ceb-815a-9c877abfd96d on hv-cinder-85083 Aug 29 19:13:26.967445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-7f17dae4-a361-43ea-8d21-1a2e3f38edbb req-8bf688aa-126a-443a-b38e-949ef3a5b4fd service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031831 Aug 29 19:13:26.968025 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 498/989] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:27.534727 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-709c796d-6148-4598-988e-e29539bc5cfa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:27.535359 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-709c796d-6148-4598-988e-e29539bc5cfa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:27.541779 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-709c796d-6148-4598-988e-e29539bc5cfa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:27.542260 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-709c796d-6148-4598-988e-e29539bc5cfa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:27.542688 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-709c796d-6148-4598-988e-e29539bc5cfa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:27.543407 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-709c796d-6148-4598-988e-e29539bc5cfa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:27.543854 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-709c796d-6148-4598-988e-e29539bc5cfa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:27.544269 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-709c796d-6148-4598-988e-e29539bc5cfa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:27.675628 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-709c796d-6148-4598-988e-e29539bc5cfa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:27.684203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-709c796d-6148-4598-988e-e29539bc5cfa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 200 len: 1366 microversion: 2.1 time: 0.153337 Aug 29 19:13:27.685030 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 492/990] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:27 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:28.703622 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:28.704561 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=6 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:28.708802 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e98fc2e0-285d-49dd-a52c-194da8661d24 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:28.709492 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e98fc2e0-285d-49dd-a52c-194da8661d24 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:28.716424 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e98fc2e0-285d-49dd-a52c-194da8661d24 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:28.716905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e98fc2e0-285d-49dd-a52c-194da8661d24 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:28.717333 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e98fc2e0-285d-49dd-a52c-194da8661d24 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:28.718009 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e98fc2e0-285d-49dd-a52c-194da8661d24 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:28.718452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e98fc2e0-285d-49dd-a52c-194da8661d24 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:28.718867 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e98fc2e0-285d-49dd-a52c-194da8661d24 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:28.847017 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e98fc2e0-285d-49dd-a52c-194da8661d24 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:28.854521 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e98fc2e0-285d-49dd-a52c-194da8661d24 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 200 len: 1366 microversion: 2.1 time: 0.152338 Aug 29 19:13:28.855092 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 499/991] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:28 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:29.875601 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0f5c00af-c582-4d73-a58c-5df8abd56fe0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:29.876167 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0f5c00af-c582-4d73-a58c-5df8abd56fe0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:29.878030 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:29.879207 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:29.885380 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f5c00af-c582-4d73-a58c-5df8abd56fe0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:29.885872 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f5c00af-c582-4d73-a58c-5df8abd56fe0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:29.886337 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f5c00af-c582-4d73-a58c-5df8abd56fe0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:29.887015 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f5c00af-c582-4d73-a58c-5df8abd56fe0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:29.887468 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f5c00af-c582-4d73-a58c-5df8abd56fe0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:29.887894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0f5c00af-c582-4d73-a58c-5df8abd56fe0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:30.027323 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0f5c00af-c582-4d73-a58c-5df8abd56fe0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:30.035663 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0f5c00af-c582-4d73-a58c-5df8abd56fe0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 200 len: 1555 microversion: 2.1 time: 0.164032 Aug 29 19:13:30.036217 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 493/992] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:29 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:30.055674 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-96b84e54-1997-48b5-bec9-e9d2e20c0f23 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:30.056181 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-96b84e54-1997-48b5-bec9-e9d2e20c0f23 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:30.062523 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96b84e54-1997-48b5-bec9-e9d2e20c0f23 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:30.062981 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96b84e54-1997-48b5-bec9-e9d2e20c0f23 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:30.063474 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96b84e54-1997-48b5-bec9-e9d2e20c0f23 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:30.064181 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96b84e54-1997-48b5-bec9-e9d2e20c0f23 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:30.064644 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96b84e54-1997-48b5-bec9-e9d2e20c0f23 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:30.065069 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96b84e54-1997-48b5-bec9-e9d2e20c0f23 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:30.144897 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-96b84e54-1997-48b5-bec9-e9d2e20c0f23 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093004 Aug 29 19:13:30.145492 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 500/993] 10.222.0.86 () {58 vars in 1275 bytes} [Mon Aug 29 19:13:30 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:31.345276 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-4cfe8edc-e866-468a-9b49-11a80d978aac req-df7434bb-2bd1-488b-a04f-7b6b74cac42c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8f7dba-a886-4ceb-815a-9c877abfd96d", "tag": "942d1592-aedb-4c4c-b557-2e53b2a12a6b"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:31.355328 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-4cfe8edc-e866-468a-9b49-11a80d978aac req-df7434bb-2bd1-488b-a04f-7b6b74cac42c service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:31.355809 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-4cfe8edc-e866-468a-9b49-11a80d978aac req-df7434bb-2bd1-488b-a04f-7b6b74cac42c service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:31.356270 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-4cfe8edc-e866-468a-9b49-11a80d978aac req-df7434bb-2bd1-488b-a04f-7b6b74cac42c service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:31.367433 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-4cfe8edc-e866-468a-9b49-11a80d978aac req-df7434bb-2bd1-488b-a04f-7b6b74cac42c service nova] Creating event network-changed:942d1592-aedb-4c4c-b557-2e53b2a12a6b for instance df8f7dba-a886-4ceb-815a-9c877abfd96d on hv-cinder-85083 Aug 29 19:13:31.372504 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-4cfe8edc-e866-468a-9b49-11a80d978aac req-df7434bb-2bd1-488b-a04f-7b6b74cac42c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030945 Aug 29 19:13:31.373173 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 494/994] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:04.869838 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:04.870590 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=34 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:04.874944 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-de337642-00eb-4ae2-93f5-40a77025702f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:04.877183 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-de337642-00eb-4ae2-93f5-40a77025702f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:04.884494 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de337642-00eb-4ae2-93f5-40a77025702f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:04.884981 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de337642-00eb-4ae2-93f5-40a77025702f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:04.885412 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de337642-00eb-4ae2-93f5-40a77025702f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:04.886104 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de337642-00eb-4ae2-93f5-40a77025702f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:04.886555 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de337642-00eb-4ae2-93f5-40a77025702f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:04.886979 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-de337642-00eb-4ae2-93f5-40a77025702f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:04.916106 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-de337642-00eb-4ae2-93f5-40a77025702f tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048039 Aug 29 19:14:04.916659 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 501/995] 10.222.0.86 () {60 vars in 1343 bytes} [Mon Aug 29 19:14:04 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:04.979427 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:04.980267 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=38 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:04.984420 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a13422c7-f98c-43ce-9fe7-d30cf2259b52 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:04.985023 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a13422c7-f98c-43ce-9fe7-d30cf2259b52 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:04.992894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a13422c7-f98c-43ce-9fe7-d30cf2259b52 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:04.993375 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a13422c7-f98c-43ce-9fe7-d30cf2259b52 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:04.993807 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a13422c7-f98c-43ce-9fe7-d30cf2259b52 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:04.994517 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a13422c7-f98c-43ce-9fe7-d30cf2259b52 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:04.994966 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a13422c7-f98c-43ce-9fe7-d30cf2259b52 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:04.995416 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a13422c7-f98c-43ce-9fe7-d30cf2259b52 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:05.020196 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a13422c7-f98c-43ce-9fe7-d30cf2259b52 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:14:05.093707 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a13422c7-f98c-43ce-9fe7-d30cf2259b52 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "DELETE /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 204 len: 0 microversion: 2.20 time: 0.116086 Aug 29 19:14:05.094301 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 495/996] 10.222.0.86 () {60 vars in 1280 bytes} [Mon Aug 29 19:14:04 2022] DELETE /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 19:14:05.103618 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6c0757e8-47cd-4f93-b5aa-08dc71dc8113 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:05.104224 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6c0757e8-47cd-4f93-b5aa-08dc71dc8113 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:05.110180 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c0757e8-47cd-4f93-b5aa-08dc71dc8113 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:05.111335 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c0757e8-47cd-4f93-b5aa-08dc71dc8113 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:05.111770 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c0757e8-47cd-4f93-b5aa-08dc71dc8113 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:05.112456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c0757e8-47cd-4f93-b5aa-08dc71dc8113 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:05.112906 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c0757e8-47cd-4f93-b5aa-08dc71dc8113 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:05.113359 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c0757e8-47cd-4f93-b5aa-08dc71dc8113 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:05.244892 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6c0757e8-47cd-4f93-b5aa-08dc71dc8113 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:05.253100 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6c0757e8-47cd-4f93-b5aa-08dc71dc8113 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:05.254551 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6c0757e8-47cd-4f93-b5aa-08dc71dc8113 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:05.255746 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6c0757e8-47cd-4f93-b5aa-08dc71dc8113 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.156028 Aug 29 19:14:05.256300 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 502/997] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:05 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:06.279923 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-55096098-b3c4-40f7-8753-9dbc66feeecb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:06.280624 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-55096098-b3c4-40f7-8753-9dbc66feeecb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:06.287710 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55096098-b3c4-40f7-8753-9dbc66feeecb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:06.288197 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55096098-b3c4-40f7-8753-9dbc66feeecb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:06.288635 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55096098-b3c4-40f7-8753-9dbc66feeecb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:06.289326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55096098-b3c4-40f7-8753-9dbc66feeecb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:06.289778 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55096098-b3c4-40f7-8753-9dbc66feeecb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:06.290204 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55096098-b3c4-40f7-8753-9dbc66feeecb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:06.419472 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-55096098-b3c4-40f7-8753-9dbc66feeecb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:06.427498 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-55096098-b3c4-40f7-8753-9dbc66feeecb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:06.428960 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-55096098-b3c4-40f7-8753-9dbc66feeecb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:06.430139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-55096098-b3c4-40f7-8753-9dbc66feeecb tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.154611 Aug 29 19:14:06.430699 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 496/998] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:06 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:07.453676 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f1f51b48-fb47-486a-bd8d-9ddd7e3d7bf4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:07.454883 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f1f51b48-fb47-486a-bd8d-9ddd7e3d7bf4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:07.461353 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f1f51b48-fb47-486a-bd8d-9ddd7e3d7bf4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:07.461833 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f1f51b48-fb47-486a-bd8d-9ddd7e3d7bf4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:07.462292 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f1f51b48-fb47-486a-bd8d-9ddd7e3d7bf4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:07.463020 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f1f51b48-fb47-486a-bd8d-9ddd7e3d7bf4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:07.463571 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f1f51b48-fb47-486a-bd8d-9ddd7e3d7bf4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:07.463993 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f1f51b48-fb47-486a-bd8d-9ddd7e3d7bf4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:07.737802 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f1f51b48-fb47-486a-bd8d-9ddd7e3d7bf4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:07.745740 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f1f51b48-fb47-486a-bd8d-9ddd7e3d7bf4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:07.747482 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f1f51b48-fb47-486a-bd8d-9ddd7e3d7bf4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:07.748653 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f1f51b48-fb47-486a-bd8d-9ddd7e3d7bf4 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1722 microversion: 2.20 time: 0.299802 Aug 29 19:14:07.749201 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 503/999] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:07 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:08.160289 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-8aba11d6-0f0e-419a-aec0-3b41cf1ee80e req-60fb51b3-f635-4c49-8798-ca3b3d63726d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77353c2d-0418-48b1-a87a-2b6d8cc0f96e", "name": "network-vif-deleted", "tag": "67ef5167-9ef6-4f02-967f-ca2f8ed4953a"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:08.171290 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8aba11d6-0f0e-419a-aec0-3b41cf1ee80e req-60fb51b3-f635-4c49-8798-ca3b3d63726d service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:08.171797 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8aba11d6-0f0e-419a-aec0-3b41cf1ee80e req-60fb51b3-f635-4c49-8798-ca3b3d63726d service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:08.172225 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8aba11d6-0f0e-419a-aec0-3b41cf1ee80e req-60fb51b3-f635-4c49-8798-ca3b3d63726d service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:08.184951 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-8aba11d6-0f0e-419a-aec0-3b41cf1ee80e req-60fb51b3-f635-4c49-8798-ca3b3d63726d service nova] Creating event network-vif-deleted:67ef5167-9ef6-4f02-967f-ca2f8ed4953a for instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e on hv-cinder-85083 Aug 29 19:14:08.194411 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-8aba11d6-0f0e-419a-aec0-3b41cf1ee80e req-60fb51b3-f635-4c49-8798-ca3b3d63726d service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037682 Aug 29 19:14:08.195242 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 497/1000] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:08.771955 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-711d2a21-6f7e-47db-ba45-f8cd82e60489 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:08.772581 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-711d2a21-6f7e-47db-ba45-f8cd82e60489 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:08.779191 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-711d2a21-6f7e-47db-ba45-f8cd82e60489 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:08.779681 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-711d2a21-6f7e-47db-ba45-f8cd82e60489 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:08.780306 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-711d2a21-6f7e-47db-ba45-f8cd82e60489 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:08.781012 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-711d2a21-6f7e-47db-ba45-f8cd82e60489 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:08.781496 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-711d2a21-6f7e-47db-ba45-f8cd82e60489 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:08.782101 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-711d2a21-6f7e-47db-ba45-f8cd82e60489 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:08.815827 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-711d2a21-6f7e-47db-ba45-f8cd82e60489 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:08.816309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-711d2a21-6f7e-47db-ba45-f8cd82e60489 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:08.816741 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-711d2a21-6f7e-47db-ba45-f8cd82e60489 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:08.817189 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-711d2a21-6f7e-47db-ba45-f8cd82e60489 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lazy-loading 'fault' on Instance uuid 77353c2d-0418-48b1-a87a-2b6d8cc0f96e {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:14:08.865519 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-711d2a21-6f7e-47db-ba45-f8cd82e60489 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:08.876542 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-711d2a21-6f7e-47db-ba45-f8cd82e60489 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:08.878124 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-711d2a21-6f7e-47db-ba45-f8cd82e60489 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd013ba83e944ecfa1a2d0a8a0d55101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3171bab0ea547d9acc3559f449221eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:08.879359 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-711d2a21-6f7e-47db-ba45-f8cd82e60489 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 200 len: 1371 microversion: 2.20 time: 0.112389 Aug 29 19:14:08.879930 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 504/1001] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:08 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:09.903203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b989fd2b-c310-4c91-873a-a5730a7314e8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:09.903894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b989fd2b-c310-4c91-873a-a5730a7314e8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:09.910603 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b989fd2b-c310-4c91-873a-a5730a7314e8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:09.911117 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b989fd2b-c310-4c91-873a-a5730a7314e8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:09.911551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b989fd2b-c310-4c91-873a-a5730a7314e8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:09.912235 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b989fd2b-c310-4c91-873a-a5730a7314e8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:09.912686 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b989fd2b-c310-4c91-873a-a5730a7314e8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:09.913106 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b989fd2b-c310-4c91-873a-a5730a7314e8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:09.926085 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-b989fd2b-c310-4c91-873a-a5730a7314e8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] HTTP exception thrown: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b989fd2b-c310-4c91-873a-a5730a7314e8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Request method failure captured: Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e HTTP/1.1 Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0bwQqs9JR0BF81rnbuthj8pDHYQJZucD8bRN12XnCCq3h1Q9bG1wSaSIdEJFBVBNmnBtHrBi6CekBg_VOT4jh41snDvS3MOrDcGFBfHn5dwzpKZeLRNacsyxJ4Nl5L-c-ilJEDLhljN7FgbYCii7eINuhkGAeeuoPhyCF8blrRJAM Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: b3171bab0ea547d9acc3559f449221eb Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:14:09.928365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:14:09.930058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_b3171bab0ea547d9acc3559f449221eb"}]}] Aug 29 19:14:09.930058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:14:09.930058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: b3171bab0ea547d9acc3559f449221eb Aug 29 19:14:09.930058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:14:09.930058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeShelveTestJSON-487521950-project Aug 29 19:14:09.930058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:14:09.930058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:14:09.930058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: dd013ba83e944ecfa1a2d0a8a0d55101 Aug 29 19:14:09.930058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeShelveTestJSON-487521950-project Aug 29 19:14:09.930058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:14:09.930058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. Aug 29 19:14:09.930058 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': '77353c2d-0418-48b1-a87a-2b6d8cc0f96e'} Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:09.931016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. Aug 29 19:14:09.932558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:14:09.933875 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b989fd2b-c310-4c91-873a-a5730a7314e8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Returning 404 to user: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:09.933875 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b989fd2b-c310-4c91-873a-a5730a7314e8 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 404 len: 111 microversion: 2.20 time: 0.031237 Aug 29 19:14:09.933875 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 498/1002] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:09 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:14:09.938480 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9605023d-4930-4887-ac81-acc5d476e54b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '.version_select at 0x7fb2b9cb4550>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:09.958538 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9605023d-4930-4887-ac81-acc5d476e54b tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-872213877" status: 204 len: 0 microversion: 2.20 time: 0.023727 Aug 29 19:14:09.959051 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 505/1003] 10.222.0.86 () {60 vars in 1259 bytes} [Mon Aug 29 19:14:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-872213877 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 19:14:11.698352 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b0ee448e-daef-4d1b-99f3-87cc555b1281 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:11.698891 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b0ee448e-daef-4d1b-99f3-87cc555b1281 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:11.706727 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b0ee448e-daef-4d1b-99f3-87cc555b1281 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:11.707239 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b0ee448e-daef-4d1b-99f3-87cc555b1281 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:11.707672 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b0ee448e-daef-4d1b-99f3-87cc555b1281 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:11.708355 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b0ee448e-daef-4d1b-99f3-87cc555b1281 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:11.708802 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b0ee448e-daef-4d1b-99f3-87cc555b1281 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:11.709219 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b0ee448e-daef-4d1b-99f3-87cc555b1281 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:11.722439 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-b0ee448e-daef-4d1b-99f3-87cc555b1281 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] HTTP exception thrown: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b0ee448e-daef-4d1b-99f3-87cc555b1281 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Request method failure captured: Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: DELETE /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e HTTP/1.1 Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0bwQqs9JR0BF81rnbuthj8pDHYQJZucD8bRN12XnCCq3h1Q9bG1wSaSIdEJFBVBNmnBtHrBi6CekBg_VOT4jh41snDvS3MOrDcGFBfHn5dwzpKZeLRNacsyxJ4Nl5L-c-ilJEDLhljN7FgbYCii7eINuhkGAeeuoPhyCF8blrRJAM Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: b3171bab0ea547d9acc3559f449221eb Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:14:11.723994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:14:11.725651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_b3171bab0ea547d9acc3559f449221eb"}]}] Aug 29 19:14:11.725651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:14:11.725651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: b3171bab0ea547d9acc3559f449221eb Aug 29 19:14:11.725651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:14:11.725651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeShelveTestJSON-487521950-project Aug 29 19:14:11.725651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:14:11.725651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:14:11.725651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: dd013ba83e944ecfa1a2d0a8a0d55101 Aug 29 19:14:11.725651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeShelveTestJSON-487521950-project Aug 29 19:14:11.725651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:14:11.725651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. Aug 29 19:14:11.725651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': '77353c2d-0418-48b1-a87a-2b6d8cc0f96e'} Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:11.728996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. Aug 29 19:14:11.730467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:14:11.731927 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b0ee448e-daef-4d1b-99f3-87cc555b1281 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Returning 404 to user: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:11.731927 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b0ee448e-daef-4d1b-99f3-87cc555b1281 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "DELETE /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 404 len: 111 microversion: 2.20 time: 0.030859 Aug 29 19:14:11.731927 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 499/1004] 10.222.0.86 () {60 vars in 1280 bytes} [Mon Aug 29 19:14:11 2022] DELETE /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:14:11.734195 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-df39be9a-903d-475f-8b92-dbf968f8762d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:11.734809 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-df39be9a-903d-475f-8b92-dbf968f8762d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 77353c2d-0418-48b1-a87a-2b6d8cc0f96e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:11.741806 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df39be9a-903d-475f-8b92-dbf968f8762d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:11.742286 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df39be9a-903d-475f-8b92-dbf968f8762d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:11.742715 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df39be9a-903d-475f-8b92-dbf968f8762d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:11.743430 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df39be9a-903d-475f-8b92-dbf968f8762d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:11.743877 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df39be9a-903d-475f-8b92-dbf968f8762d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:11.744297 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df39be9a-903d-475f-8b92-dbf968f8762d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:11.758539 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-df39be9a-903d-475f-8b92-dbf968f8762d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] HTTP exception thrown: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-df39be9a-903d-475f-8b92-dbf968f8762d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Request method failure captured: Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e HTTP/1.1 Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ0bwQqs9JR0BF81rnbuthj8pDHYQJZucD8bRN12XnCCq3h1Q9bG1wSaSIdEJFBVBNmnBtHrBi6CekBg_VOT4jh41snDvS3MOrDcGFBfHn5dwzpKZeLRNacsyxJ4Nl5L-c-ilJEDLhljN7FgbYCii7eINuhkGAeeuoPhyCF8blrRJAM Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: b3171bab0ea547d9acc3559f449221eb Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:14:11.760376 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:14:11.762027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_b3171bab0ea547d9acc3559f449221eb"}]}] Aug 29 19:14:11.762027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:14:11.762027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: b3171bab0ea547d9acc3559f449221eb Aug 29 19:14:11.762027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:14:11.762027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeShelveTestJSON-487521950-project Aug 29 19:14:11.762027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:14:11.762027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:14:11.762027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: dd013ba83e944ecfa1a2d0a8a0d55101 Aug 29 19:14:11.762027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeShelveTestJSON-487521950-project Aug 29 19:14:11.762027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:14:11.762027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. Aug 29 19:14:11.762027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': '77353c2d-0418-48b1-a87a-2b6d8cc0f96e'} Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:11.766407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. Aug 29 19:14:11.769452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:14:11.770806 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-df39be9a-903d-475f-8b92-dbf968f8762d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Returning 404 to user: Instance 77353c2d-0418-48b1-a87a-2b6d8cc0f96e could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:11.770806 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-df39be9a-903d-475f-8b92-dbf968f8762d tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e" status: 404 len: 111 microversion: 2.20 time: 0.031886 Aug 29 19:14:11.770806 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 506/1005] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:11 2022] GET /compute/v2.1/servers/77353c2d-0418-48b1-a87a-2b6d8cc0f96e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:14:12.912777 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-814d5fb7-703b-409d-8d2a-5599d3eac4b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:12.913272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-814d5fb7-703b-409d-8d2a-5599d3eac4b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:12.919807 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-814d5fb7-703b-409d-8d2a-5599d3eac4b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:12.920288 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-814d5fb7-703b-409d-8d2a-5599d3eac4b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:12.920718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-814d5fb7-703b-409d-8d2a-5599d3eac4b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:12.921399 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-814d5fb7-703b-409d-8d2a-5599d3eac4b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:12.921848 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-814d5fb7-703b-409d-8d2a-5599d3eac4b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:12.922269 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-814d5fb7-703b-409d-8d2a-5599d3eac4b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:12.935890 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-814d5fb7-703b-409d-8d2a-5599d3eac4b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] HTTP exception thrown: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-814d5fb7-703b-409d-8d2a-5599d3eac4b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Request method failure captured: Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: DELETE /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 HTTP/1.1 Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ0bwQqs9JR0BF81rnbuthj8pDHYQJZucD8bRN12XnCCq3h1Q9bG1wSaSIdEJFBVBNmnBtHrBi6CekBg_VOT4jh41snDvS3MOrDcGFBfHn5dwzpKZeLRNacsyxJ4Nl5L-c-ilJEDLhljN7FgbYCii7eINuhkGAeeuoPhyCF8blrRJAM Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: b3171bab0ea547d9acc3559f449221eb Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:14:12.937422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:14:12.939622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_b3171bab0ea547d9acc3559f449221eb"}]}] Aug 29 19:14:12.939622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:14:12.939622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: b3171bab0ea547d9acc3559f449221eb Aug 29 19:14:12.939622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:14:12.939622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeShelveTestJSON-487521950-project Aug 29 19:14:12.939622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:14:12.939622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:14:12.939622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: dd013ba83e944ecfa1a2d0a8a0d55101 Aug 29 19:14:12.939622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeShelveTestJSON-487521950-project Aug 29 19:14:12.939622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:14:12.939622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. Aug 29 19:14:12.939622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': '55705ba3-2981-43e1-80e0-29995ee472a9'} Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:12.940494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. Aug 29 19:14:12.942044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:14:12.943550 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-814d5fb7-703b-409d-8d2a-5599d3eac4b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Returning 404 to user: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:12.943550 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-814d5fb7-703b-409d-8d2a-5599d3eac4b7 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "DELETE /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 404 len: 111 microversion: 2.20 time: 0.030562 Aug 29 19:14:12.943550 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 500/1006] 10.222.0.86 () {60 vars in 1280 bytes} [Mon Aug 29 19:14:12 2022] DELETE /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:14:12.947976 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-505ce379-2e97-4a51-ae23-417573224cc3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:12.948589 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-505ce379-2e97-4a51-ae23-417573224cc3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] [instance: 55705ba3-2981-43e1-80e0-29995ee472a9] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:12.955334 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-505ce379-2e97-4a51-ae23-417573224cc3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:12.955821 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-505ce379-2e97-4a51-ae23-417573224cc3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:12.956345 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-505ce379-2e97-4a51-ae23-417573224cc3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:12.956931 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-505ce379-2e97-4a51-ae23-417573224cc3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:12.957386 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-505ce379-2e97-4a51-ae23-417573224cc3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:12.957813 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-505ce379-2e97-4a51-ae23-417573224cc3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:12.971075 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-505ce379-2e97-4a51-ae23-417573224cc3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] HTTP exception thrown: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-505ce379-2e97-4a51-ae23-417573224cc3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Request method failure captured: Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 HTTP/1.1 Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ0bwQqs9JR0BF81rnbuthj8pDHYQJZucD8bRN12XnCCq3h1Q9bG1wSaSIdEJFBVBNmnBtHrBi6CekBg_VOT4jh41snDvS3MOrDcGFBfHn5dwzpKZeLRNacsyxJ4Nl5L-c-ilJEDLhljN7FgbYCii7eINuhkGAeeuoPhyCF8blrRJAM Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: b3171bab0ea547d9acc3559f449221eb Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:14:12.972564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:14:12.974247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/b3171bab0ea547d9acc3559f449221eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_b3171bab0ea547d9acc3559f449221eb"}]}] Aug 29 19:14:12.974247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:14:12.974247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: b3171bab0ea547d9acc3559f449221eb Aug 29 19:14:12.974247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-487521950 Aug 29 19:14:12.974247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeShelveTestJSON-487521950-project Aug 29 19:14:12.974247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:14:12.974247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:14:12.974247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: dd013ba83e944ecfa1a2d0a8a0d55101 Aug 29 19:14:12.974247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeShelveTestJSON-487521950-project Aug 29 19:14:12.974247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:14:12.974247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. Aug 29 19:14:12.974247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': '55705ba3-2981-43e1-80e0-29995ee472a9'} Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:12.975374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. Aug 29 19:14:12.976848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:14:12.978327 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-505ce379-2e97-4a51-ae23-417573224cc3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] Returning 404 to user: Instance 55705ba3-2981-43e1-80e0-29995ee472a9 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:12.978327 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-505ce379-2e97-4a51-ae23-417573224cc3 tempest-AttachVolumeShelveTestJSON-487521950 tempest-AttachVolumeShelveTestJSON-487521950-project] 10.222.0.86 "GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9" status: 404 len: 111 microversion: 2.20 time: 0.029860 Aug 29 19:14:12.978327 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 507/1007] 10.222.0.86 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:12 2022] GET /compute/v2.1/servers/55705ba3-2981-43e1-80e0-29995ee472a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:14:49.243118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-222262459", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-950876423", "security_groups": [{"name": "tempest-secgroup-smoke-1075310592"}], "block_device_mapping_v2": [{"uuid": "52863042-a85e-4af1-ae93-f697d9ad70b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "230bc59f-c520-4141-9d7a-a6fcb67f0194"}]}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:49.253920 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:49.254551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:49.364042 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] validate_networks() for [('230bc59f-c520-4141-9d7a-a6fcb67f0194', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:14:49.849986 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:14:49.850410 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:14:49.850883 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:14:49.851357 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:14:49.851793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:14:49.861688 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:49.862205 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:49.862691 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:49.863500 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:49.864027 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:49.864514 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:49.881827 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Getting quotas for project 5d70fdff5c5a443b9f0ae1a24dfffcd3. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:14:49.886249 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Getting quotas for user 0547f15d00f043b99de10f3db7348c62 and project 5d70fdff5c5a443b9f0ae1a24dfffcd3. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:14:49.944903 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:14:49.946979 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='52863042-a85e-4af1-ae93-f697d9ad70b1',volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:14:50.074253 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-04bd6289-1892-45cc-9257-78b8a492018b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.834933 Aug 29 19:14:50.074887 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 501/1008] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:14:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:14:50.086266 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-71741f1d-aae4-4b03-93b7-3c61b5b8d173 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:50.086808 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-71741f1d-aae4-4b03-93b7-3c61b5b8d173 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:50.088993 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:50.089828 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=30 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:50.147346 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-71741f1d-aae4-4b03-93b7-3c61b5b8d173 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:50.154289 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-71741f1d-aae4-4b03-93b7-3c61b5b8d173 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1093 microversion: 2.1 time: 0.071795 Aug 29 19:14:50.154837 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 508/1009] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:50 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:51.174741 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-62c31f51-f877-439d-9ede-0dfc9a437851 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:51.175388 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-62c31f51-f877-439d-9ede-0dfc9a437851 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:51.182087 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-62c31f51-f877-439d-9ede-0dfc9a437851 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:51.182576 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-62c31f51-f877-439d-9ede-0dfc9a437851 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:51.183024 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-62c31f51-f877-439d-9ede-0dfc9a437851 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:51.183715 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-62c31f51-f877-439d-9ede-0dfc9a437851 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:51.184171 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-62c31f51-f877-439d-9ede-0dfc9a437851 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:51.184595 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-62c31f51-f877-439d-9ede-0dfc9a437851 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:51.257517 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-62c31f51-f877-439d-9ede-0dfc9a437851 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:51.265645 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-62c31f51-f877-439d-9ede-0dfc9a437851 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1191 microversion: 2.1 time: 0.095789 Aug 29 19:14:51.266435 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 502/1010] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:51 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1191 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:14:52.286469 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9fc32843-9392-4c00-a8f4-75e81b904381 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:52.287345 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9fc32843-9392-4c00-a8f4-75e81b904381 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:52.294073 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9fc32843-9392-4c00-a8f4-75e81b904381 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:52.294562 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9fc32843-9392-4c00-a8f4-75e81b904381 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:52.294990 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9fc32843-9392-4c00-a8f4-75e81b904381 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:52.295701 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9fc32843-9392-4c00-a8f4-75e81b904381 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:52.296150 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9fc32843-9392-4c00-a8f4-75e81b904381 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:52.296567 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9fc32843-9392-4c00-a8f4-75e81b904381 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:52.492378 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9fc32843-9392-4c00-a8f4-75e81b904381 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:52.500260 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9fc32843-9392-4c00-a8f4-75e81b904381 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1265 microversion: 2.1 time: 0.217995 Aug 29 19:14:52.500824 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 509/1011] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:52 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:52.862507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-804a94ec-23e5-4e1b-89c3-a483643a57e3 req-c192c862-a562-47dc-9dbf-012580a7f6dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9daa10b3-9082-45da-b64d-21be15641cdd", "tag": "2f716230-73f0-46ca-b3c8-2c534d6bab51"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:52.872101 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-804a94ec-23e5-4e1b-89c3-a483643a57e3 req-c192c862-a562-47dc-9dbf-012580a7f6dd service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:52.872650 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-804a94ec-23e5-4e1b-89c3-a483643a57e3 req-c192c862-a562-47dc-9dbf-012580a7f6dd service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:52.873081 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-804a94ec-23e5-4e1b-89c3-a483643a57e3 req-c192c862-a562-47dc-9dbf-012580a7f6dd service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:52.883776 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-804a94ec-23e5-4e1b-89c3-a483643a57e3 req-c192c862-a562-47dc-9dbf-012580a7f6dd service nova] Creating event network-changed:2f716230-73f0-46ca-b3c8-2c534d6bab51 for instance 9daa10b3-9082-45da-b64d-21be15641cdd on hv-cinder-85083 Aug 29 19:14:52.888904 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-804a94ec-23e5-4e1b-89c3-a483643a57e3 req-c192c862-a562-47dc-9dbf-012580a7f6dd service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154734 Aug 29 19:14:52.889812 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 503/1012] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:53.521182 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-154a518c-1759-481e-9492-7bce3f30bb7e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:53.521741 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-154a518c-1759-481e-9492-7bce3f30bb7e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:53.528877 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-154a518c-1759-481e-9492-7bce3f30bb7e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:53.529567 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-154a518c-1759-481e-9492-7bce3f30bb7e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:53.530325 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-154a518c-1759-481e-9492-7bce3f30bb7e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:53.531126 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-154a518c-1759-481e-9492-7bce3f30bb7e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:53.531728 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-154a518c-1759-481e-9492-7bce3f30bb7e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:53.532203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-154a518c-1759-481e-9492-7bce3f30bb7e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:53.666255 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-154a518c-1759-481e-9492-7bce3f30bb7e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:53.673875 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-154a518c-1759-481e-9492-7bce3f30bb7e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1265 microversion: 2.1 time: 0.157239 Aug 29 19:14:53.674438 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 510/1013] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:53 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:54.696258 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cd7b4d14-c3a4-400c-acd1-949d35317896 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:54.696945 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-cd7b4d14-c3a4-400c-acd1-949d35317896 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:54.703415 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cd7b4d14-c3a4-400c-acd1-949d35317896 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:54.703892 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cd7b4d14-c3a4-400c-acd1-949d35317896 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:54.704321 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cd7b4d14-c3a4-400c-acd1-949d35317896 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:54.704997 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cd7b4d14-c3a4-400c-acd1-949d35317896 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:54.705440 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cd7b4d14-c3a4-400c-acd1-949d35317896 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:54.705902 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cd7b4d14-c3a4-400c-acd1-949d35317896 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:54.833741 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-cd7b4d14-c3a4-400c-acd1-949d35317896 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:54.841486 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-cd7b4d14-c3a4-400c-acd1-949d35317896 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1265 microversion: 2.1 time: 0.149843 Aug 29 19:14:54.842026 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 504/1014] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:54 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:55.862619 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a8666d03-f020-47b6-b98a-949995e193b4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:55.863246 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a8666d03-f020-47b6-b98a-949995e193b4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:55.869695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8666d03-f020-47b6-b98a-949995e193b4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:55.870171 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8666d03-f020-47b6-b98a-949995e193b4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:55.870600 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8666d03-f020-47b6-b98a-949995e193b4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:55.871308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8666d03-f020-47b6-b98a-949995e193b4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:55.871754 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8666d03-f020-47b6-b98a-949995e193b4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:55.872165 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8666d03-f020-47b6-b98a-949995e193b4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:56.007200 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a8666d03-f020-47b6-b98a-949995e193b4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:56.015006 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a8666d03-f020-47b6-b98a-949995e193b4 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1265 microversion: 2.1 time: 0.157011 Aug 29 19:14:56.015566 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 511/1015] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:55 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:57.035927 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-45f9f8ae-d3cd-4301-a34a-58d133a5b230 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:57.036535 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-45f9f8ae-d3cd-4301-a34a-58d133a5b230 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:57.042886 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-45f9f8ae-d3cd-4301-a34a-58d133a5b230 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:57.043391 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-45f9f8ae-d3cd-4301-a34a-58d133a5b230 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:57.043823 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-45f9f8ae-d3cd-4301-a34a-58d133a5b230 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:57.044496 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-45f9f8ae-d3cd-4301-a34a-58d133a5b230 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:57.044942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-45f9f8ae-d3cd-4301-a34a-58d133a5b230 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:57.045357 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-45f9f8ae-d3cd-4301-a34a-58d133a5b230 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:57.175319 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-45f9f8ae-d3cd-4301-a34a-58d133a5b230 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:57.182946 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-45f9f8ae-d3cd-4301-a34a-58d133a5b230 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1265 microversion: 2.1 time: 0.150902 Aug 29 19:14:57.183531 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 505/1016] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:57 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:58.205426 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-34e00c34-625a-4176-bfe7-c7fc013be521 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:58.206039 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-34e00c34-625a-4176-bfe7-c7fc013be521 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:58.212847 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-34e00c34-625a-4176-bfe7-c7fc013be521 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:58.213340 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-34e00c34-625a-4176-bfe7-c7fc013be521 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:58.213782 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-34e00c34-625a-4176-bfe7-c7fc013be521 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:58.214497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-34e00c34-625a-4176-bfe7-c7fc013be521 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:58.215160 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-34e00c34-625a-4176-bfe7-c7fc013be521 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:58.215472 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-34e00c34-625a-4176-bfe7-c7fc013be521 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:58.349701 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-34e00c34-625a-4176-bfe7-c7fc013be521 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:58.357470 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-34e00c34-625a-4176-bfe7-c7fc013be521 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1265 microversion: 2.1 time: 0.156180 Aug 29 19:14:58.358007 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 512/1017] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:58 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:59.377763 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-075b97c6-d662-46e1-a7dd-9a6964bb4d4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:59.378395 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-075b97c6-d662-46e1-a7dd-9a6964bb4d4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:59.384786 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-075b97c6-d662-46e1-a7dd-9a6964bb4d4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:59.385267 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-075b97c6-d662-46e1-a7dd-9a6964bb4d4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:59.385702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-075b97c6-d662-46e1-a7dd-9a6964bb4d4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:59.386389 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-075b97c6-d662-46e1-a7dd-9a6964bb4d4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:59.386851 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-075b97c6-d662-46e1-a7dd-9a6964bb4d4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:59.387369 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-075b97c6-d662-46e1-a7dd-9a6964bb4d4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:59.524171 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-075b97c6-d662-46e1-a7dd-9a6964bb4d4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:59.531744 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-075b97c6-d662-46e1-a7dd-9a6964bb4d4f tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1265 microversion: 2.1 time: 0.157885 Aug 29 19:14:59.532890 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 506/1018] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:59 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:00.554015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-365b462e-7294-4b2e-bc42-4a5dabbb5a16 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:00.554626 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-365b462e-7294-4b2e-bc42-4a5dabbb5a16 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:00.556731 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:00.561997 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-365b462e-7294-4b2e-bc42-4a5dabbb5a16 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:00.562484 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-365b462e-7294-4b2e-bc42-4a5dabbb5a16 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:00.562923 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-365b462e-7294-4b2e-bc42-4a5dabbb5a16 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:00.563636 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-365b462e-7294-4b2e-bc42-4a5dabbb5a16 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:00.564090 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-365b462e-7294-4b2e-bc42-4a5dabbb5a16 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:00.564513 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-365b462e-7294-4b2e-bc42-4a5dabbb5a16 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:00.691150 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-365b462e-7294-4b2e-bc42-4a5dabbb5a16 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:00.698820 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-365b462e-7294-4b2e-bc42-4a5dabbb5a16 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1265 microversion: 2.1 time: 0.148654 Aug 29 19:15:00.699516 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 513/1019] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:00 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:01.720966 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-478571a1-356c-4b3a-88e3-c83df03b5e3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:01.721666 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-478571a1-356c-4b3a-88e3-c83df03b5e3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:01.723731 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:01.724550 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:01.733929 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-478571a1-356c-4b3a-88e3-c83df03b5e3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:01.734704 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-478571a1-356c-4b3a-88e3-c83df03b5e3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:01.735376 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-478571a1-356c-4b3a-88e3-c83df03b5e3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:01.736403 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-478571a1-356c-4b3a-88e3-c83df03b5e3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:01.737147 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-478571a1-356c-4b3a-88e3-c83df03b5e3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:01.737837 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-478571a1-356c-4b3a-88e3-c83df03b5e3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:01.903077 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-478571a1-356c-4b3a-88e3-c83df03b5e3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:01.911252 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-478571a1-356c-4b3a-88e3-c83df03b5e3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1265 microversion: 2.1 time: 0.194826 Aug 29 19:15:01.911810 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 507/1020] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:01 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:02.932259 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-87de5c3d-271c-4da1-ad01-5313f9b2677b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:02.932875 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-87de5c3d-271c-4da1-ad01-5313f9b2677b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:02.939472 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-87de5c3d-271c-4da1-ad01-5313f9b2677b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:02.939963 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-87de5c3d-271c-4da1-ad01-5313f9b2677b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:02.940397 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-87de5c3d-271c-4da1-ad01-5313f9b2677b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:02.941081 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-87de5c3d-271c-4da1-ad01-5313f9b2677b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:02.941527 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-87de5c3d-271c-4da1-ad01-5313f9b2677b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:02.941945 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-87de5c3d-271c-4da1-ad01-5313f9b2677b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:03.076880 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-87de5c3d-271c-4da1-ad01-5313f9b2677b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:03.084995 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-87de5c3d-271c-4da1-ad01-5313f9b2677b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1265 microversion: 2.1 time: 0.156664 Aug 29 19:15:03.085560 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 514/1021] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:02 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:04.105659 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0eddaa8c-48f0-46fb-8e59-cfa5de80a20c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:04.106292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0eddaa8c-48f0-46fb-8e59-cfa5de80a20c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:04.112725 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0eddaa8c-48f0-46fb-8e59-cfa5de80a20c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:04.113226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0eddaa8c-48f0-46fb-8e59-cfa5de80a20c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:04.113663 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0eddaa8c-48f0-46fb-8e59-cfa5de80a20c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:04.114355 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0eddaa8c-48f0-46fb-8e59-cfa5de80a20c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:04.114811 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0eddaa8c-48f0-46fb-8e59-cfa5de80a20c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:04.115259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0eddaa8c-48f0-46fb-8e59-cfa5de80a20c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:04.248847 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0eddaa8c-48f0-46fb-8e59-cfa5de80a20c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:04.256955 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0eddaa8c-48f0-46fb-8e59-cfa5de80a20c tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1265 microversion: 2.1 time: 0.155223 Aug 29 19:15:04.257520 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 508/1022] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:04 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:05.279750 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1b063ffb-c72a-459b-b176-0109cc934e9b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:05.280375 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1b063ffb-c72a-459b-b176-0109cc934e9b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:05.287516 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b063ffb-c72a-459b-b176-0109cc934e9b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:05.288002 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b063ffb-c72a-459b-b176-0109cc934e9b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:05.288430 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b063ffb-c72a-459b-b176-0109cc934e9b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:05.289121 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b063ffb-c72a-459b-b176-0109cc934e9b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:05.289575 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b063ffb-c72a-459b-b176-0109cc934e9b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:05.289994 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b063ffb-c72a-459b-b176-0109cc934e9b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:05.423190 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1b063ffb-c72a-459b-b176-0109cc934e9b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:05.431200 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1b063ffb-c72a-459b-b176-0109cc934e9b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1265 microversion: 2.1 time: 0.156705 Aug 29 19:15:05.431760 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 515/1023] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:05 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:06.452702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e7cb2211-ec93-4a72-b1d7-1da9a0aaecba tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:06.453250 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e7cb2211-ec93-4a72-b1d7-1da9a0aaecba tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:06.460672 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e7cb2211-ec93-4a72-b1d7-1da9a0aaecba tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:06.461159 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e7cb2211-ec93-4a72-b1d7-1da9a0aaecba tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:06.461596 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e7cb2211-ec93-4a72-b1d7-1da9a0aaecba tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:06.462287 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e7cb2211-ec93-4a72-b1d7-1da9a0aaecba tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:06.462742 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e7cb2211-ec93-4a72-b1d7-1da9a0aaecba tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:06.463209 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e7cb2211-ec93-4a72-b1d7-1da9a0aaecba tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:06.598381 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e7cb2211-ec93-4a72-b1d7-1da9a0aaecba tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:06.606144 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e7cb2211-ec93-4a72-b1d7-1da9a0aaecba tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1265 microversion: 2.1 time: 0.157801 Aug 29 19:15:06.606704 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 509/1024] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:06 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:07.628095 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-088d0f8d-abb5-4b98-ae60-04417f89f094 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:07.628805 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-088d0f8d-abb5-4b98-ae60-04417f89f094 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:07.635454 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-088d0f8d-abb5-4b98-ae60-04417f89f094 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:07.636036 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-088d0f8d-abb5-4b98-ae60-04417f89f094 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:07.636543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-088d0f8d-abb5-4b98-ae60-04417f89f094 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:07.637334 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-088d0f8d-abb5-4b98-ae60-04417f89f094 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:07.637850 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-088d0f8d-abb5-4b98-ae60-04417f89f094 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:07.638339 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-088d0f8d-abb5-4b98-ae60-04417f89f094 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:07.726547 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-ddd9cd28-f32e-4dec-881f-605e4f8e96e4 req-41d230c9-5591-4882-b8f9-b191b5ba6343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daa10b3-9082-45da-b64d-21be15641cdd", "name": "network-vif-plugged", "status": "completed", "tag": "2f716230-73f0-46ca-b3c8-2c534d6bab51"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:07.745029 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ddd9cd28-f32e-4dec-881f-605e4f8e96e4 req-41d230c9-5591-4882-b8f9-b191b5ba6343 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:07.745863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ddd9cd28-f32e-4dec-881f-605e4f8e96e4 req-41d230c9-5591-4882-b8f9-b191b5ba6343 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:07.746726 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ddd9cd28-f32e-4dec-881f-605e4f8e96e4 req-41d230c9-5591-4882-b8f9-b191b5ba6343 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:07.758812 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-ddd9cd28-f32e-4dec-881f-605e4f8e96e4 req-41d230c9-5591-4882-b8f9-b191b5ba6343 service nova] Creating event network-vif-plugged:2f716230-73f0-46ca-b3c8-2c534d6bab51 for instance 9daa10b3-9082-45da-b64d-21be15641cdd on hv-cinder-85083 Aug 29 19:15:07.764147 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-ddd9cd28-f32e-4dec-881f-605e4f8e96e4 req-41d230c9-5591-4882-b8f9-b191b5ba6343 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042466 Aug 29 19:15:07.764933 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 510/1025] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:15:07.774442 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-088d0f8d-abb5-4b98-ae60-04417f89f094 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:07.783086 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-088d0f8d-abb5-4b98-ae60-04417f89f094 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1265 microversion: 2.1 time: 0.159814 Aug 29 19:15:07.783663 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 516/1026] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:07 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:08.804782 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3c71b8ac-6931-4aa9-ad6b-8513ebd33bca tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:08.805466 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3c71b8ac-6931-4aa9-ad6b-8513ebd33bca tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:08.812141 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c71b8ac-6931-4aa9-ad6b-8513ebd33bca tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:08.812621 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c71b8ac-6931-4aa9-ad6b-8513ebd33bca tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:08.813571 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c71b8ac-6931-4aa9-ad6b-8513ebd33bca tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:08.814248 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c71b8ac-6931-4aa9-ad6b-8513ebd33bca tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:08.814696 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c71b8ac-6931-4aa9-ad6b-8513ebd33bca tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:08.815144 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3c71b8ac-6931-4aa9-ad6b-8513ebd33bca tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:08.963699 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3c71b8ac-6931-4aa9-ad6b-8513ebd33bca tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:08.971371 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3c71b8ac-6931-4aa9-ad6b-8513ebd33bca tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1265 microversion: 2.1 time: 0.171014 Aug 29 19:15:08.971926 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 511/1027] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:08 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:09.993519 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f119827d-05c7-418d-817e-0cee27f72259 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:09.994074 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f119827d-05c7-418d-817e-0cee27f72259 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:10.001034 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f119827d-05c7-418d-817e-0cee27f72259 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:10.001530 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f119827d-05c7-418d-817e-0cee27f72259 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:10.001962 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f119827d-05c7-418d-817e-0cee27f72259 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:10.002665 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f119827d-05c7-418d-817e-0cee27f72259 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:10.003151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f119827d-05c7-418d-817e-0cee27f72259 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:10.003573 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f119827d-05c7-418d-817e-0cee27f72259 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:10.133587 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f119827d-05c7-418d-817e-0cee27f72259 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:10.142077 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f119827d-05c7-418d-817e-0cee27f72259 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1265 microversion: 2.1 time: 0.151993 Aug 29 19:15:10.142648 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 517/1028] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:09 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:11.163420 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1d21b3af-7127-4918-918e-007cfe898f3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:11.164022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1d21b3af-7127-4918-918e-007cfe898f3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:11.170411 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d21b3af-7127-4918-918e-007cfe898f3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:11.170886 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d21b3af-7127-4918-918e-007cfe898f3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:11.171345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d21b3af-7127-4918-918e-007cfe898f3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:11.172022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d21b3af-7127-4918-918e-007cfe898f3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:11.172569 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d21b3af-7127-4918-918e-007cfe898f3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:11.173526 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d21b3af-7127-4918-918e-007cfe898f3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:11.310044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1d21b3af-7127-4918-918e-007cfe898f3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:11.317807 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1d21b3af-7127-4918-918e-007cfe898f3e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1453 microversion: 2.1 time: 0.158355 Aug 29 19:15:11.318364 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 512/1029] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:11 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:11.339576 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d2829b64-a648-4902-a70c-3c731d785ff7 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:11.340205 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d2829b64-a648-4902-a70c-3c731d785ff7 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:11.347260 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2829b64-a648-4902-a70c-3c731d785ff7 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:11.347743 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2829b64-a648-4902-a70c-3c731d785ff7 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:11.348175 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2829b64-a648-4902-a70c-3c731d785ff7 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:11.348852 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2829b64-a648-4902-a70c-3c731d785ff7 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:11.349303 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2829b64-a648-4902-a70c-3c731d785ff7 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:11.349722 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2829b64-a648-4902-a70c-3c731d785ff7 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:11.482751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d2829b64-a648-4902-a70c-3c731d785ff7 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:11.490609 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d2829b64-a648-4902-a70c-3c731d785ff7 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1453 microversion: 2.1 time: 0.154908 Aug 29 19:15:11.491201 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 518/1030] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:11 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:13.552883 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-e5b4e107-92aa-42e1-b121-21cf5ec42854 req-4220493f-cc31-4cd7-8123-e4e1c742aed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9daa10b3-9082-45da-b64d-21be15641cdd", "tag": "2f716230-73f0-46ca-b3c8-2c534d6bab51"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:13.562827 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-e5b4e107-92aa-42e1-b121-21cf5ec42854 req-4220493f-cc31-4cd7-8123-e4e1c742aed7 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:13.563608 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-e5b4e107-92aa-42e1-b121-21cf5ec42854 req-4220493f-cc31-4cd7-8123-e4e1c742aed7 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:13.564352 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-e5b4e107-92aa-42e1-b121-21cf5ec42854 req-4220493f-cc31-4cd7-8123-e4e1c742aed7 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:13.581267 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-e5b4e107-92aa-42e1-b121-21cf5ec42854 req-4220493f-cc31-4cd7-8123-e4e1c742aed7 service nova] Creating event network-changed:2f716230-73f0-46ca-b3c8-2c534d6bab51 for instance 9daa10b3-9082-45da-b64d-21be15641cdd on hv-cinder-85083 Aug 29 19:15:13.586784 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-e5b4e107-92aa-42e1-b121-21cf5ec42854 req-4220493f-cc31-4cd7-8123-e4e1c742aed7 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094052 Aug 29 19:15:13.587801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 513/1031] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:23.507437 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6a9c9171-6d8d-4a9f-afd5-391f1bae072f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:23.507980 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6a9c9171-6d8d-4a9f-afd5-391f1bae072f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:23.510359 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=24 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:23.511033 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=60 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:23.516628 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a9c9171-6d8d-4a9f-afd5-391f1bae072f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:23.517106 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a9c9171-6d8d-4a9f-afd5-391f1bae072f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:23.517536 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a9c9171-6d8d-4a9f-afd5-391f1bae072f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:23.518218 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a9c9171-6d8d-4a9f-afd5-391f1bae072f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:23.518670 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a9c9171-6d8d-4a9f-afd5-391f1bae072f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:23.519127 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a9c9171-6d8d-4a9f-afd5-391f1bae072f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:23.540853 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-6a9c9171-6d8d-4a9f-afd5-391f1bae072f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lazy-loading 'flavor' on Instance uuid dd46fd90-e3ac-4556-927a-14ce6c51239e {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:15:23.612754 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6a9c9171-6d8d-4a9f-afd5-391f1bae072f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "POST /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e/action" status: 202 len: 0 microversion: 2.1 time: 0.109249 Aug 29 19:15:23.613322 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 519/1032] 10.222.0.86 () {60 vars in 1278 bytes} [Mon Aug 29 19:15:23 2022] POST /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:15:23.622134 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0ad46eef-d1f9-4a3c-b2b7-01b2b84e38e5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:23.623007 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0ad46eef-d1f9-4a3c-b2b7-01b2b84e38e5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:23.625399 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:23.626034 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=62 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:23.631287 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ad46eef-d1f9-4a3c-b2b7-01b2b84e38e5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:23.631775 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ad46eef-d1f9-4a3c-b2b7-01b2b84e38e5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:23.632207 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ad46eef-d1f9-4a3c-b2b7-01b2b84e38e5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:23.632965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ad46eef-d1f9-4a3c-b2b7-01b2b84e38e5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:23.633375 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ad46eef-d1f9-4a3c-b2b7-01b2b84e38e5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:23.633792 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ad46eef-d1f9-4a3c-b2b7-01b2b84e38e5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:23.764601 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0ad46eef-d1f9-4a3c-b2b7-01b2b84e38e5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:23.772246 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0ad46eef-d1f9-4a3c-b2b7-01b2b84e38e5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.154365 Aug 29 19:15:23.772798 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 514/1033] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:23 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:24.794813 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-769afd55-43f8-4c18-9c81-032a303bf0ac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:24.795537 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-769afd55-43f8-4c18-9c81-032a303bf0ac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:24.802151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-769afd55-43f8-4c18-9c81-032a303bf0ac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:24.802636 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-769afd55-43f8-4c18-9c81-032a303bf0ac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:24.803097 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-769afd55-43f8-4c18-9c81-032a303bf0ac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:24.803785 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-769afd55-43f8-4c18-9c81-032a303bf0ac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:24.804239 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-769afd55-43f8-4c18-9c81-032a303bf0ac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:24.804658 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-769afd55-43f8-4c18-9c81-032a303bf0ac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:24.943573 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-769afd55-43f8-4c18-9c81-032a303bf0ac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:24.951267 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-769afd55-43f8-4c18-9c81-032a303bf0ac tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.161104 Aug 29 19:15:24.952087 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 520/1034] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:24 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:25.973268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3f7c41db-c239-43a0-9505-a6807194ed68 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:25.973814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3f7c41db-c239-43a0-9505-a6807194ed68 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:25.980295 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3f7c41db-c239-43a0-9505-a6807194ed68 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:25.980778 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3f7c41db-c239-43a0-9505-a6807194ed68 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:25.981213 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3f7c41db-c239-43a0-9505-a6807194ed68 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:25.981905 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3f7c41db-c239-43a0-9505-a6807194ed68 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:25.982358 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3f7c41db-c239-43a0-9505-a6807194ed68 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:25.982790 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3f7c41db-c239-43a0-9505-a6807194ed68 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:26.110432 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3f7c41db-c239-43a0-9505-a6807194ed68 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:26.118156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3f7c41db-c239-43a0-9505-a6807194ed68 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.149472 Aug 29 19:15:26.118720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 515/1035] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:25 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:27.022768 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-11f2893a-b1b3-4b34-a057-74b25eea365a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:27.023359 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-11f2893a-b1b3-4b34-a057-74b25eea365a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:27.029771 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11f2893a-b1b3-4b34-a057-74b25eea365a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:27.030258 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11f2893a-b1b3-4b34-a057-74b25eea365a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:27.030697 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11f2893a-b1b3-4b34-a057-74b25eea365a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:27.031439 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11f2893a-b1b3-4b34-a057-74b25eea365a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:27.031894 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11f2893a-b1b3-4b34-a057-74b25eea365a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:27.032318 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11f2893a-b1b3-4b34-a057-74b25eea365a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:27.055737 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-11f2893a-b1b3-4b34-a057-74b25eea365a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d/ips" status: 200 len: 149 microversion: 2.1 time: 0.036815 Aug 29 19:15:27.056296 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 521/1036] 10.222.0.86 () {58 vars in 1248 bytes} [Mon Aug 29 19:15:27 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:27.139426 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fdd81f37-4131-48b3-a43f-81d7c45bed8f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:27.140033 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fdd81f37-4131-48b3-a43f-81d7c45bed8f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:27.147263 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fdd81f37-4131-48b3-a43f-81d7c45bed8f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:27.147741 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fdd81f37-4131-48b3-a43f-81d7c45bed8f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:27.148415 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fdd81f37-4131-48b3-a43f-81d7c45bed8f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:27.149100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fdd81f37-4131-48b3-a43f-81d7c45bed8f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:27.150174 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fdd81f37-4131-48b3-a43f-81d7c45bed8f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:27.150174 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fdd81f37-4131-48b3-a43f-81d7c45bed8f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:27.290898 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fdd81f37-4131-48b3-a43f-81d7c45bed8f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:27.304156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fdd81f37-4131-48b3-a43f-81d7c45bed8f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.168492 Aug 29 19:15:27.305077 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 516/1037] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:27 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:28.327187 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-856008a1-9d16-4820-bbae-f6d1b7df46fc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:28.327796 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-856008a1-9d16-4820-bbae-f6d1b7df46fc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:28.334157 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-856008a1-9d16-4820-bbae-f6d1b7df46fc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:28.334644 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-856008a1-9d16-4820-bbae-f6d1b7df46fc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:28.335110 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-856008a1-9d16-4820-bbae-f6d1b7df46fc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:28.335799 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-856008a1-9d16-4820-bbae-f6d1b7df46fc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:28.336253 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-856008a1-9d16-4820-bbae-f6d1b7df46fc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:28.336668 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-856008a1-9d16-4820-bbae-f6d1b7df46fc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:28.469802 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-856008a1-9d16-4820-bbae-f6d1b7df46fc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:28.477525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-856008a1-9d16-4820-bbae-f6d1b7df46fc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.154511 Aug 29 19:15:28.478083 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 522/1038] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:28 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:29.487964 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8ae4022a-34f1-4d8c-af45-f13f9045f268 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7ca8ddf-67da-4865-9212-ed69e91c3054"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:29.490297 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8ae4022a-34f1-4d8c-af45-f13f9045f268 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:29.496694 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8ae4022a-34f1-4d8c-af45-f13f9045f268 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:29.497193 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8ae4022a-34f1-4d8c-af45-f13f9045f268 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:29.497610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8ae4022a-34f1-4d8c-af45-f13f9045f268 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:29.497762 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4c792dbb-c686-4b26-be3b-1138808ae86d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:29.498242 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4c792dbb-c686-4b26-be3b-1138808ae86d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:29.498360 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8ae4022a-34f1-4d8c-af45-f13f9045f268 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:29.498737 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8ae4022a-34f1-4d8c-af45-f13f9045f268 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:29.499193 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8ae4022a-34f1-4d8c-af45-f13f9045f268 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:29.504519 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c792dbb-c686-4b26-be3b-1138808ae86d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:29.504997 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c792dbb-c686-4b26-be3b-1138808ae86d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:29.505426 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c792dbb-c686-4b26-be3b-1138808ae86d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:29.506112 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c792dbb-c686-4b26-be3b-1138808ae86d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:29.506564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c792dbb-c686-4b26-be3b-1138808ae86d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:29.506982 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4c792dbb-c686-4b26-be3b-1138808ae86d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:29.648143 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4c792dbb-c686-4b26-be3b-1138808ae86d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:29.655901 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4c792dbb-c686-4b26-be3b-1138808ae86d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.162118 Aug 29 19:15:29.656494 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 523/1039] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:29 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:15:29.782061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8ae4022a-34f1-4d8c-af45-f13f9045f268 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "POST /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297861 Aug 29 19:15:29.782669 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 517/1040] 10.222.0.86 () {60 vars in 1323 bytes} [Mon Aug 29 19:15:29 2022] POST /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:30.678202 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ff21c623-23df-464a-9270-ca309c44409f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:30.678843 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ff21c623-23df-464a-9270-ca309c44409f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:30.685078 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff21c623-23df-464a-9270-ca309c44409f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:30.685507 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff21c623-23df-464a-9270-ca309c44409f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:30.685944 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff21c623-23df-464a-9270-ca309c44409f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:30.686638 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff21c623-23df-464a-9270-ca309c44409f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:30.687125 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff21c623-23df-464a-9270-ca309c44409f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:30.687608 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff21c623-23df-464a-9270-ca309c44409f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:30.820084 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ff21c623-23df-464a-9270-ca309c44409f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:30.828035 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ff21c623-23df-464a-9270-ca309c44409f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.153879 Aug 29 19:15:30.829147 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 524/1041] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:30 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:31.850613 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2181b79a-ec1d-4a87-ad93-af05b4de8062 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:31.851525 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2181b79a-ec1d-4a87-ad93-af05b4de8062 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:31.858002 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2181b79a-ec1d-4a87-ad93-af05b4de8062 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:31.858488 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2181b79a-ec1d-4a87-ad93-af05b4de8062 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:31.858923 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2181b79a-ec1d-4a87-ad93-af05b4de8062 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:31.859641 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2181b79a-ec1d-4a87-ad93-af05b4de8062 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:31.860093 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2181b79a-ec1d-4a87-ad93-af05b4de8062 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:31.860519 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2181b79a-ec1d-4a87-ad93-af05b4de8062 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:32.019549 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2181b79a-ec1d-4a87-ad93-af05b4de8062 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:32.031022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2181b79a-ec1d-4a87-ad93-af05b4de8062 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.179585 Aug 29 19:15:32.031022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 518/1042] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:31 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:33.046459 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c0965e6c-a530-44ea-85ff-09b57c6e7bad tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:33.047812 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c0965e6c-a530-44ea-85ff-09b57c6e7bad tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:33.054355 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0965e6c-a530-44ea-85ff-09b57c6e7bad tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:33.054839 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0965e6c-a530-44ea-85ff-09b57c6e7bad tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:33.055334 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0965e6c-a530-44ea-85ff-09b57c6e7bad tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:33.056051 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0965e6c-a530-44ea-85ff-09b57c6e7bad tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:33.056506 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0965e6c-a530-44ea-85ff-09b57c6e7bad tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:33.057128 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0965e6c-a530-44ea-85ff-09b57c6e7bad tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:33.194417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c0965e6c-a530-44ea-85ff-09b57c6e7bad tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:33.202487 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c0965e6c-a530-44ea-85ff-09b57c6e7bad tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.159839 Aug 29 19:15:33.203064 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 525/1043] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:33 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:34.222531 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-530750b0-52c7-4b42-9b8f-3a2ccb49cedc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:34.223299 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-530750b0-52c7-4b42-9b8f-3a2ccb49cedc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:34.229778 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-530750b0-52c7-4b42-9b8f-3a2ccb49cedc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:34.230251 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-530750b0-52c7-4b42-9b8f-3a2ccb49cedc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:34.230837 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-530750b0-52c7-4b42-9b8f-3a2ccb49cedc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:34.231559 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-530750b0-52c7-4b42-9b8f-3a2ccb49cedc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:34.232009 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-530750b0-52c7-4b42-9b8f-3a2ccb49cedc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:34.232421 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-530750b0-52c7-4b42-9b8f-3a2ccb49cedc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:34.371529 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-530750b0-52c7-4b42-9b8f-3a2ccb49cedc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:34.380017 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-530750b0-52c7-4b42-9b8f-3a2ccb49cedc tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.161355 Aug 29 19:15:34.380572 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 519/1044] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:34 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:35.400817 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1d3f4436-afa2-4e59-a00e-5a6306aaa478 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:35.401429 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1d3f4436-afa2-4e59-a00e-5a6306aaa478 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:35.408642 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d3f4436-afa2-4e59-a00e-5a6306aaa478 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:35.409120 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d3f4436-afa2-4e59-a00e-5a6306aaa478 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:35.409614 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d3f4436-afa2-4e59-a00e-5a6306aaa478 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:35.410239 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d3f4436-afa2-4e59-a00e-5a6306aaa478 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:35.410684 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d3f4436-afa2-4e59-a00e-5a6306aaa478 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:35.411130 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d3f4436-afa2-4e59-a00e-5a6306aaa478 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:35.823377 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1d3f4436-afa2-4e59-a00e-5a6306aaa478 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:35.831907 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1d3f4436-afa2-4e59-a00e-5a6306aaa478 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.434903 Aug 29 19:15:35.832472 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 526/1045] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:35 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:36.853174 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9b4e8a9a-d728-412c-9d2d-4144f68b7210 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:36.853901 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9b4e8a9a-d728-412c-9d2d-4144f68b7210 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:36.860918 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b4e8a9a-d728-412c-9d2d-4144f68b7210 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:36.861388 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b4e8a9a-d728-412c-9d2d-4144f68b7210 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:36.861873 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b4e8a9a-d728-412c-9d2d-4144f68b7210 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:36.862657 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b4e8a9a-d728-412c-9d2d-4144f68b7210 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:36.863223 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b4e8a9a-d728-412c-9d2d-4144f68b7210 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:36.863676 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b4e8a9a-d728-412c-9d2d-4144f68b7210 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:36.997139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9b4e8a9a-d728-412c-9d2d-4144f68b7210 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:37.005500 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9b4e8a9a-d728-412c-9d2d-4144f68b7210 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.156306 Aug 29 19:15:37.006061 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 520/1046] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:36 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:38.026733 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a27136e0-c688-4062-a68a-bb6e48c608e7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:38.027395 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a27136e0-c688-4062-a68a-bb6e48c608e7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:38.034143 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a27136e0-c688-4062-a68a-bb6e48c608e7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:38.034633 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a27136e0-c688-4062-a68a-bb6e48c608e7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:38.035096 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a27136e0-c688-4062-a68a-bb6e48c608e7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:38.035798 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a27136e0-c688-4062-a68a-bb6e48c608e7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:38.036263 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a27136e0-c688-4062-a68a-bb6e48c608e7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:38.036684 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a27136e0-c688-4062-a68a-bb6e48c608e7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:38.169500 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a27136e0-c688-4062-a68a-bb6e48c608e7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:38.177867 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a27136e0-c688-4062-a68a-bb6e48c608e7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.155020 Aug 29 19:15:38.178468 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 527/1047] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:38 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:38.375722 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-076b88ec-fe8d-427e-a5c2-5789dde2ec96 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Action: 'create', calling method: .version_select at 0x7fb2b9eb3160>, body: {"keypair": {"name": "tempest-keypair-1994158161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQqCYbx6v8/dVPr/hURykGlDc7isyePZhhq48kOjVHKDRw7/8qP6M8bnxB2c7tLcCXQusOtWZab4AT2mc4/492SRByezoh9+OxA2olSa3F/9+FBLfNT0q5gGGqxL7pfvg=="}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:38.392269 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-076b88ec-fe8d-427e-a5c2-5789dde2ec96 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Getting quotas for project fe9fc68075be4712a305fb8a15c91f19. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:15:38.396493 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-076b88ec-fe8d-427e-a5c2-5789dde2ec96 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Getting quotas for user a982dbba4a324a4f893e427000ce9b93 and project fe9fc68075be4712a305fb8a15c91f19. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:15:38.421437 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-076b88ec-fe8d-427e-a5c2-5789dde2ec96 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049822 Aug 29 19:15:38.422164 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 521/1048] 10.222.0.86 () {60 vars in 1159 bytes} [Mon Aug 29 19:15:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:39.202688 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b373421e-850a-48c8-9bca-fc2cbbb241c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:39.203729 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b373421e-850a-48c8-9bca-fc2cbbb241c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:39.210836 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b373421e-850a-48c8-9bca-fc2cbbb241c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:39.211564 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b373421e-850a-48c8-9bca-fc2cbbb241c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:39.212161 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b373421e-850a-48c8-9bca-fc2cbbb241c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:39.212857 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b373421e-850a-48c8-9bca-fc2cbbb241c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:39.213465 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b373421e-850a-48c8-9bca-fc2cbbb241c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:39.214045 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b373421e-850a-48c8-9bca-fc2cbbb241c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:39.450439 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b373421e-850a-48c8-9bca-fc2cbbb241c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:39.463177 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b373421e-850a-48c8-9bca-fc2cbbb241c5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.266960 Aug 29 19:15:39.465495 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 528/1049] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:39 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:39.849383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-580985049", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c198086-2b12-4afa-9f22-a31dfbf52cb2"}], "security_groups": [{"name": "tempest-securitygroup--542906820"}], "key_name": "tempest-keypair-1994158161", "user_data": "}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:39.949591 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] validate_networks() for [('2c198086-2b12-4afa-9f22-a31dfbf52cb2', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:15:40.314828 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:15:40.315283 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:15:40.315765 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:15:40.316197 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:15:40.316607 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:15:40.325277 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:40.325753 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:40.326195 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:40.327213 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:40.327664 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:40.328084 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:40.345053 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Getting quotas for project fe9fc68075be4712a305fb8a15c91f19. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:15:40.349153 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Getting quotas for user a982dbba4a324a4f893e427000ce9b93 and project fe9fc68075be4712a305fb8a15c91f19. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:15:40.360070 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:15:40.362345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:15:40.409038 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-59e13004-2ff8-4fb2-aac3-6cbb8b66b1ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.565089 Aug 29 19:15:40.409597 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 522/1050] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:15:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:15:40.420256 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-15bcebcb-9379-48f6-be25-022d1550ac54 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:40.420873 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-15bcebcb-9379-48f6-be25-022d1550ac54 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:40.475693 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-15bcebcb-9379-48f6-be25-022d1550ac54 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:40.482905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-15bcebcb-9379-48f6-be25-022d1550ac54 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1241 microversion: 2.1 time: 0.066416 Aug 29 19:15:40.483749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 529/1051] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:40 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:15:40.487451 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7f84f4b2-f6f1-453a-ac5a-f3b27146cffd tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:40.488273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7f84f4b2-f6f1-453a-ac5a-f3b27146cffd tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:40.495100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7f84f4b2-f6f1-453a-ac5a-f3b27146cffd tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:40.495807 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7f84f4b2-f6f1-453a-ac5a-f3b27146cffd tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:40.496266 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7f84f4b2-f6f1-453a-ac5a-f3b27146cffd tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:40.496953 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7f84f4b2-f6f1-453a-ac5a-f3b27146cffd tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:40.497407 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7f84f4b2-f6f1-453a-ac5a-f3b27146cffd tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:40.497833 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7f84f4b2-f6f1-453a-ac5a-f3b27146cffd tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:40.655263 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7f84f4b2-f6f1-453a-ac5a-f3b27146cffd tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:40.663143 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7f84f4b2-f6f1-453a-ac5a-f3b27146cffd tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.180032 Aug 29 19:15:40.663644 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 523/1052] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:40 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:41.504823 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5ad21d44-9abe-46b1-8c3a-f6ce89bab393 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:41.505441 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5ad21d44-9abe-46b1-8c3a-f6ce89bab393 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:41.512410 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ad21d44-9abe-46b1-8c3a-f6ce89bab393 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:41.512892 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ad21d44-9abe-46b1-8c3a-f6ce89bab393 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:41.513326 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ad21d44-9abe-46b1-8c3a-f6ce89bab393 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:41.514004 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ad21d44-9abe-46b1-8c3a-f6ce89bab393 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:41.514451 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ad21d44-9abe-46b1-8c3a-f6ce89bab393 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:41.514869 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ad21d44-9abe-46b1-8c3a-f6ce89bab393 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:41.582312 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5ad21d44-9abe-46b1-8c3a-f6ce89bab393 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:41.589929 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5ad21d44-9abe-46b1-8c3a-f6ce89bab393 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1293 microversion: 2.1 time: 0.089347 Aug 29 19:15:41.590511 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 530/1053] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:41 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:41.689966 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-464ff731-ef2b-439e-bb4e-79b3ca692030 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:41.690945 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-464ff731-ef2b-439e-bb4e-79b3ca692030 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:41.699328 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-464ff731-ef2b-439e-bb4e-79b3ca692030 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:41.699840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-464ff731-ef2b-439e-bb4e-79b3ca692030 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:41.700278 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-464ff731-ef2b-439e-bb4e-79b3ca692030 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:41.701210 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-464ff731-ef2b-439e-bb4e-79b3ca692030 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:41.702188 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-464ff731-ef2b-439e-bb4e-79b3ca692030 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:41.702697 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-464ff731-ef2b-439e-bb4e-79b3ca692030 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:41.878805 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-464ff731-ef2b-439e-bb4e-79b3ca692030 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:41.887146 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-464ff731-ef2b-439e-bb4e-79b3ca692030 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.206182 Aug 29 19:15:41.887703 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 524/1054] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:41 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:42.610442 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2df13e1d-6fa4-4c0c-b8c1-2c96b21fcb6e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:42.611070 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2df13e1d-6fa4-4c0c-b8c1-2c96b21fcb6e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:42.617468 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2df13e1d-6fa4-4c0c-b8c1-2c96b21fcb6e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:42.617945 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2df13e1d-6fa4-4c0c-b8c1-2c96b21fcb6e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:42.618374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2df13e1d-6fa4-4c0c-b8c1-2c96b21fcb6e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:42.619075 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2df13e1d-6fa4-4c0c-b8c1-2c96b21fcb6e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:42.619536 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2df13e1d-6fa4-4c0c-b8c1-2c96b21fcb6e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:42.619954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2df13e1d-6fa4-4c0c-b8c1-2c96b21fcb6e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:42.680993 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2df13e1d-6fa4-4c0c-b8c1-2c96b21fcb6e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:42.689449 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2df13e1d-6fa4-4c0c-b8c1-2c96b21fcb6e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1301 microversion: 2.1 time: 0.082871 Aug 29 19:15:42.690093 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 531/1055] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:42 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1301 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:42.909345 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-280a1d13-ca22-4ccf-99fe-b35be4ba264f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:42.909970 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-280a1d13-ca22-4ccf-99fe-b35be4ba264f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:42.916774 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-280a1d13-ca22-4ccf-99fe-b35be4ba264f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:42.917287 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-280a1d13-ca22-4ccf-99fe-b35be4ba264f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:42.917718 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-280a1d13-ca22-4ccf-99fe-b35be4ba264f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:42.918405 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-280a1d13-ca22-4ccf-99fe-b35be4ba264f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:42.918858 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-280a1d13-ca22-4ccf-99fe-b35be4ba264f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:42.919318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-280a1d13-ca22-4ccf-99fe-b35be4ba264f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:43.054772 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-280a1d13-ca22-4ccf-99fe-b35be4ba264f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:43.063136 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-280a1d13-ca22-4ccf-99fe-b35be4ba264f tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1569 microversion: 2.1 time: 0.157941 Aug 29 19:15:43.063705 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 525/1056] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:42 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:43.084133 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-efc5b6d2-cc56-4f28-abc1-0e1bdbb35ab7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:43.084778 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-efc5b6d2-cc56-4f28-abc1-0e1bdbb35ab7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:43.090746 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efc5b6d2-cc56-4f28-abc1-0e1bdbb35ab7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:43.091271 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efc5b6d2-cc56-4f28-abc1-0e1bdbb35ab7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:43.091707 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efc5b6d2-cc56-4f28-abc1-0e1bdbb35ab7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:43.092394 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efc5b6d2-cc56-4f28-abc1-0e1bdbb35ab7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:43.092850 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efc5b6d2-cc56-4f28-abc1-0e1bdbb35ab7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:43.093272 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efc5b6d2-cc56-4f28-abc1-0e1bdbb35ab7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:43.233790 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-efc5b6d2-cc56-4f28-abc1-0e1bdbb35ab7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120707) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 19:15:43.299868 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-efc5b6d2-cc56-4f28-abc1-0e1bdbb35ab7 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "POST /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e/action" status: 202 len: 0 microversion: 2.1 time: 0.219588 Aug 29 19:15:43.300469 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 532/1057] 10.222.0.86 () {60 vars in 1278 bytes} [Mon Aug 29 19:15:43 2022] POST /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:15:43.308654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8f79a277-7a58-4916-9ac5-df01dd69a9b4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:43.309266 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8f79a277-7a58-4916-9ac5-df01dd69a9b4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:43.315809 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8f79a277-7a58-4916-9ac5-df01dd69a9b4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:43.316290 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8f79a277-7a58-4916-9ac5-df01dd69a9b4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:43.316723 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8f79a277-7a58-4916-9ac5-df01dd69a9b4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:43.317416 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8f79a277-7a58-4916-9ac5-df01dd69a9b4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:43.317868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8f79a277-7a58-4916-9ac5-df01dd69a9b4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:43.318291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8f79a277-7a58-4916-9ac5-df01dd69a9b4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:43.466620 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8f79a277-7a58-4916-9ac5-df01dd69a9b4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:43.475593 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8f79a277-7a58-4916-9ac5-df01dd69a9b4 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1577 microversion: 2.1 time: 0.170891 Aug 29 19:15:43.476302 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 526/1058] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:43 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:43.710582 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7516face-1e62-4747-a2d9-e2c4f3ff5083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:43.711232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7516face-1e62-4747-a2d9-e2c4f3ff5083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:43.718828 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7516face-1e62-4747-a2d9-e2c4f3ff5083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:43.719336 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7516face-1e62-4747-a2d9-e2c4f3ff5083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:43.719773 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7516face-1e62-4747-a2d9-e2c4f3ff5083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:43.720975 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7516face-1e62-4747-a2d9-e2c4f3ff5083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:43.721581 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7516face-1e62-4747-a2d9-e2c4f3ff5083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:43.722005 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7516face-1e62-4747-a2d9-e2c4f3ff5083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:43.782561 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7516face-1e62-4747-a2d9-e2c4f3ff5083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:43.786035 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:43.791473 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7516face-1e62-4747-a2d9-e2c4f3ff5083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1301 microversion: 2.1 time: 0.085374 Aug 29 19:15:43.792036 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 533/1059] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:43 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:44.496585 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d1289c93-65b0-4a5b-8ab1-a1d3cbaea2a5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:44.497244 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d1289c93-65b0-4a5b-8ab1-a1d3cbaea2a5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:44.503719 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d1289c93-65b0-4a5b-8ab1-a1d3cbaea2a5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:44.504201 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d1289c93-65b0-4a5b-8ab1-a1d3cbaea2a5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:44.504630 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d1289c93-65b0-4a5b-8ab1-a1d3cbaea2a5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:44.505311 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d1289c93-65b0-4a5b-8ab1-a1d3cbaea2a5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:44.505793 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d1289c93-65b0-4a5b-8ab1-a1d3cbaea2a5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:44.506211 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d1289c93-65b0-4a5b-8ab1-a1d3cbaea2a5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:44.636450 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d1289c93-65b0-4a5b-8ab1-a1d3cbaea2a5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:44.644642 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d1289c93-65b0-4a5b-8ab1-a1d3cbaea2a5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1577 microversion: 2.1 time: 0.151924 Aug 29 19:15:44.645190 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 527/1060] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:44 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:44.812101 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4b41222a-692c-4cdf-b9fa-9c23cc5c3ba0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:44.813239 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4b41222a-692c-4cdf-b9fa-9c23cc5c3ba0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:44.821718 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b41222a-692c-4cdf-b9fa-9c23cc5c3ba0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:44.822201 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b41222a-692c-4cdf-b9fa-9c23cc5c3ba0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:44.822631 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b41222a-692c-4cdf-b9fa-9c23cc5c3ba0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:44.823340 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b41222a-692c-4cdf-b9fa-9c23cc5c3ba0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:44.823788 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b41222a-692c-4cdf-b9fa-9c23cc5c3ba0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:44.824206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b41222a-692c-4cdf-b9fa-9c23cc5c3ba0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:44.890264 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4b41222a-692c-4cdf-b9fa-9c23cc5c3ba0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:44.898690 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4b41222a-692c-4cdf-b9fa-9c23cc5c3ba0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1301 microversion: 2.1 time: 0.090454 Aug 29 19:15:44.899285 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 534/1061] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:44 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:45.052081 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-ac732251-09d2-44a2-91e6-48f97aab68b1 req-3fdc2227-5514-4faa-9090-fd73f0a62919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd46fd90-e3ac-4556-927a-14ce6c51239e", "name": "network-vif-unplugged", "status": "completed", "tag": "7b17bd15-64ac-45c7-b33b-22f23076cf55"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:45.064429 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ac732251-09d2-44a2-91e6-48f97aab68b1 req-3fdc2227-5514-4faa-9090-fd73f0a62919 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:45.065128 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ac732251-09d2-44a2-91e6-48f97aab68b1 req-3fdc2227-5514-4faa-9090-fd73f0a62919 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:45.065620 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ac732251-09d2-44a2-91e6-48f97aab68b1 req-3fdc2227-5514-4faa-9090-fd73f0a62919 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:45.080269 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-ac732251-09d2-44a2-91e6-48f97aab68b1 req-3fdc2227-5514-4faa-9090-fd73f0a62919 service nova] Creating event network-vif-unplugged:7b17bd15-64ac-45c7-b33b-22f23076cf55 for instance dd46fd90-e3ac-4556-927a-14ce6c51239e on hv-cinder-85083 Aug 29 19:15:45.085166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-ac732251-09d2-44a2-91e6-48f97aab68b1 req-3fdc2227-5514-4faa-9090-fd73f0a62919 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037009 Aug 29 19:15:45.085749 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 528/1062] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:45.665794 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ae7c6617-aa4f-4cb7-ba53-bde4c31cc9fe tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:45.666397 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ae7c6617-aa4f-4cb7-ba53-bde4c31cc9fe tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:45.673061 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae7c6617-aa4f-4cb7-ba53-bde4c31cc9fe tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:45.673543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae7c6617-aa4f-4cb7-ba53-bde4c31cc9fe tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:45.673972 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae7c6617-aa4f-4cb7-ba53-bde4c31cc9fe tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:45.674714 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae7c6617-aa4f-4cb7-ba53-bde4c31cc9fe tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:45.675195 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae7c6617-aa4f-4cb7-ba53-bde4c31cc9fe tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:45.675613 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae7c6617-aa4f-4cb7-ba53-bde4c31cc9fe tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:45.812152 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ae7c6617-aa4f-4cb7-ba53-bde4c31cc9fe tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:45.820198 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ae7c6617-aa4f-4cb7-ba53-bde4c31cc9fe tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1577 microversion: 2.1 time: 0.158359 Aug 29 19:15:45.820749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 535/1063] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:45 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:45.920231 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6473ee49-b7cc-422d-9370-3b2c08a02390 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:45.920917 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6473ee49-b7cc-422d-9370-3b2c08a02390 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:45.927066 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6473ee49-b7cc-422d-9370-3b2c08a02390 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:45.927544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6473ee49-b7cc-422d-9370-3b2c08a02390 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:45.927968 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6473ee49-b7cc-422d-9370-3b2c08a02390 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:45.928645 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6473ee49-b7cc-422d-9370-3b2c08a02390 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:45.929088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6473ee49-b7cc-422d-9370-3b2c08a02390 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:45.929507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6473ee49-b7cc-422d-9370-3b2c08a02390 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:45.991374 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6473ee49-b7cc-422d-9370-3b2c08a02390 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:45.999189 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6473ee49-b7cc-422d-9370-3b2c08a02390 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1311 microversion: 2.1 time: 0.083616 Aug 29 19:15:45.999751 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 529/1064] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:45 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1311 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:46.841746 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7074d832-a70f-457b-9e10-9e8edb5aae22 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:46.842266 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7074d832-a70f-457b-9e10-9e8edb5aae22 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:46.848620 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7074d832-a70f-457b-9e10-9e8edb5aae22 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:46.849098 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7074d832-a70f-457b-9e10-9e8edb5aae22 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:46.849524 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7074d832-a70f-457b-9e10-9e8edb5aae22 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:46.850202 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7074d832-a70f-457b-9e10-9e8edb5aae22 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:46.850651 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7074d832-a70f-457b-9e10-9e8edb5aae22 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:46.851096 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7074d832-a70f-457b-9e10-9e8edb5aae22 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:47.021733 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1b97804e-d18e-4bb1-829f-39ff8caf6317 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:47.023081 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1b97804e-d18e-4bb1-829f-39ff8caf6317 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:47.031849 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b97804e-d18e-4bb1-829f-39ff8caf6317 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:47.032605 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b97804e-d18e-4bb1-829f-39ff8caf6317 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:47.033261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b97804e-d18e-4bb1-829f-39ff8caf6317 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:47.034384 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b97804e-d18e-4bb1-829f-39ff8caf6317 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:47.035230 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b97804e-d18e-4bb1-829f-39ff8caf6317 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:47.035875 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b97804e-d18e-4bb1-829f-39ff8caf6317 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:47.090099 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7074d832-a70f-457b-9e10-9e8edb5aae22 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:47.098527 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7074d832-a70f-457b-9e10-9e8edb5aae22 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1577 microversion: 2.1 time: 0.260505 Aug 29 19:15:47.099325 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 536/1065] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:46 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1577 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:47.121608 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1b97804e-d18e-4bb1-829f-39ff8caf6317 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:47.133627 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1b97804e-d18e-4bb1-829f-39ff8caf6317 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1299 microversion: 2.1 time: 0.116979 Aug 29 19:15:47.134366 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 530/1066] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:47 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:15:48.129927 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3131d8ac-83a7-474b-90d0-4f7a9eec87e3 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:48.130624 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3131d8ac-83a7-474b-90d0-4f7a9eec87e3 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:48.139410 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3131d8ac-83a7-474b-90d0-4f7a9eec87e3 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:48.140000 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3131d8ac-83a7-474b-90d0-4f7a9eec87e3 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:48.141365 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3131d8ac-83a7-474b-90d0-4f7a9eec87e3 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:48.142315 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3131d8ac-83a7-474b-90d0-4f7a9eec87e3 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:48.143289 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3131d8ac-83a7-474b-90d0-4f7a9eec87e3 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:48.144114 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3131d8ac-83a7-474b-90d0-4f7a9eec87e3 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:48.172251 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-529915dc-22be-4e59-8e16-c79894f6c456 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:48.172875 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-529915dc-22be-4e59-8e16-c79894f6c456 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:48.190914 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-529915dc-22be-4e59-8e16-c79894f6c456 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:48.191601 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-529915dc-22be-4e59-8e16-c79894f6c456 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:48.192039 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-529915dc-22be-4e59-8e16-c79894f6c456 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:48.192854 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-529915dc-22be-4e59-8e16-c79894f6c456 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:48.193489 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-529915dc-22be-4e59-8e16-c79894f6c456 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:48.194141 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-529915dc-22be-4e59-8e16-c79894f6c456 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:48.228749 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:48.442003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3131d8ac-83a7-474b-90d0-4f7a9eec87e3 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:48.450299 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3131d8ac-83a7-474b-90d0-4f7a9eec87e3 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1519 microversion: 2.1 time: 0.324641 Aug 29 19:15:48.450874 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 537/1067] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:48 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1519 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:48.467362 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-3a7d537d-09d2-4fa0-aea1-2c2c5c992d12 req-2d71ed50-c8f2-4233-b259-61227d2376c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a07a4d70-1d0f-41b3-8efe-69013ee7ec85", "tag": "a2bccc09-69fb-48ef-8907-f73cacf5fbdd"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:48.477131 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-3a7d537d-09d2-4fa0-aea1-2c2c5c992d12 req-2d71ed50-c8f2-4233-b259-61227d2376c2 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:48.477749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-3a7d537d-09d2-4fa0-aea1-2c2c5c992d12 req-2d71ed50-c8f2-4233-b259-61227d2376c2 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:48.478301 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-3a7d537d-09d2-4fa0-aea1-2c2c5c992d12 req-2d71ed50-c8f2-4233-b259-61227d2376c2 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:48.490698 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-529915dc-22be-4e59-8e16-c79894f6c456 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:48.493192 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-3a7d537d-09d2-4fa0-aea1-2c2c5c992d12 req-2d71ed50-c8f2-4233-b259-61227d2376c2 service nova] Creating event network-changed:a2bccc09-69fb-48ef-8907-f73cacf5fbdd for instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 on hv-cinder-85083 Aug 29 19:15:48.500480 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-3a7d537d-09d2-4fa0-aea1-2c2c5c992d12 req-2d71ed50-c8f2-4233-b259-61227d2376c2 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036216 Aug 29 19:15:48.501657 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 538/1068] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:48.502483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-529915dc-22be-4e59-8e16-c79894f6c456 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1366 microversion: 2.1 time: 0.349996 Aug 29 19:15:48.503297 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 531/1069] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:48 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:49.474172 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-05319d84-cbc8-48fa-8f06-b09a1b455f9d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:49.474873 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-05319d84-cbc8-48fa-8f06-b09a1b455f9d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:49.481312 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-05319d84-cbc8-48fa-8f06-b09a1b455f9d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:49.481807 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-05319d84-cbc8-48fa-8f06-b09a1b455f9d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:49.482243 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-05319d84-cbc8-48fa-8f06-b09a1b455f9d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:49.482939 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-05319d84-cbc8-48fa-8f06-b09a1b455f9d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:49.483424 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-05319d84-cbc8-48fa-8f06-b09a1b455f9d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:49.483846 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-05319d84-cbc8-48fa-8f06-b09a1b455f9d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:49.523813 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0ac92ab0-4095-4e70-a2bc-c955bc62a34a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:49.524568 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0ac92ab0-4095-4e70-a2bc-c955bc62a34a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:49.530987 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ac92ab0-4095-4e70-a2bc-c955bc62a34a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:49.532242 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ac92ab0-4095-4e70-a2bc-c955bc62a34a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:49.532672 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ac92ab0-4095-4e70-a2bc-c955bc62a34a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:49.533362 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ac92ab0-4095-4e70-a2bc-c955bc62a34a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:49.533805 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ac92ab0-4095-4e70-a2bc-c955bc62a34a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:49.534226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ac92ab0-4095-4e70-a2bc-c955bc62a34a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:49.662375 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-05319d84-cbc8-48fa-8f06-b09a1b455f9d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:49.670230 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-05319d84-cbc8-48fa-8f06-b09a1b455f9d tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1575 microversion: 2.1 time: 0.201333 Aug 29 19:15:49.670801 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 539/1070] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:49 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:49.698447 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0ac92ab0-4095-4e70-a2bc-c955bc62a34a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:49.708079 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0ac92ab0-4095-4e70-a2bc-c955bc62a34a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1366 microversion: 2.1 time: 0.188067 Aug 29 19:15:49.708656 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 532/1071] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:49 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:15:50.694718 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cc7cdbeb-82bd-4776-8049-9bc3b78c9fd9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:50.695380 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cc7cdbeb-82bd-4776-8049-9bc3b78c9fd9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:50.697846 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:50.703588 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cc7cdbeb-82bd-4776-8049-9bc3b78c9fd9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:50.704083 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cc7cdbeb-82bd-4776-8049-9bc3b78c9fd9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:50.704523 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cc7cdbeb-82bd-4776-8049-9bc3b78c9fd9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:50.705222 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cc7cdbeb-82bd-4776-8049-9bc3b78c9fd9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:50.705682 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cc7cdbeb-82bd-4776-8049-9bc3b78c9fd9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:50.706108 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cc7cdbeb-82bd-4776-8049-9bc3b78c9fd9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:50.730166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-501022d3-7629-485e-a3b1-683c9e06c9b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:50.730786 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-501022d3-7629-485e-a3b1-683c9e06c9b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:50.732729 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:50.734884 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=10 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:50.742596 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-501022d3-7629-485e-a3b1-683c9e06c9b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:50.743360 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-501022d3-7629-485e-a3b1-683c9e06c9b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:50.744011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-501022d3-7629-485e-a3b1-683c9e06c9b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:50.744959 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-501022d3-7629-485e-a3b1-683c9e06c9b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:50.745625 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-501022d3-7629-485e-a3b1-683c9e06c9b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:50.746443 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-501022d3-7629-485e-a3b1-683c9e06c9b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:50.903983 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cc7cdbeb-82bd-4776-8049-9bc3b78c9fd9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:50.914100 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cc7cdbeb-82bd-4776-8049-9bc3b78c9fd9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1575 microversion: 2.1 time: 0.225208 Aug 29 19:15:50.915039 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 540/1072] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:50 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:50.953986 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-501022d3-7629-485e-a3b1-683c9e06c9b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:50.961548 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-501022d3-7629-485e-a3b1-683c9e06c9b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1366 microversion: 2.1 time: 0.235480 Aug 29 19:15:50.962107 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 533/1073] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:50 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:51.937047 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-91236aeb-3bd1-460f-9779-fc40f1cc33d5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:51.937663 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-91236aeb-3bd1-460f-9779-fc40f1cc33d5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:51.950751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91236aeb-3bd1-460f-9779-fc40f1cc33d5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:51.951269 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91236aeb-3bd1-460f-9779-fc40f1cc33d5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:51.951707 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91236aeb-3bd1-460f-9779-fc40f1cc33d5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:51.952668 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91236aeb-3bd1-460f-9779-fc40f1cc33d5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:51.953646 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91236aeb-3bd1-460f-9779-fc40f1cc33d5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:51.954072 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91236aeb-3bd1-460f-9779-fc40f1cc33d5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:51.983278 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-63f4e310-107f-4670-baf4-fc91b63121bb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:51.985168 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-63f4e310-107f-4670-baf4-fc91b63121bb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:51.992041 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63f4e310-107f-4670-baf4-fc91b63121bb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:51.992527 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63f4e310-107f-4670-baf4-fc91b63121bb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:51.992960 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63f4e310-107f-4670-baf4-fc91b63121bb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:51.993797 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63f4e310-107f-4670-baf4-fc91b63121bb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:51.994241 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63f4e310-107f-4670-baf4-fc91b63121bb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:51.994709 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63f4e310-107f-4670-baf4-fc91b63121bb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:52.235549 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-91236aeb-3bd1-460f-9779-fc40f1cc33d5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:52.253392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-91236aeb-3bd1-460f-9779-fc40f1cc33d5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1575 microversion: 2.1 time: 0.318588 Aug 29 19:15:52.253971 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 541/1074] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:51 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1575 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:52.257014 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-63f4e310-107f-4670-baf4-fc91b63121bb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:52.265158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-63f4e310-107f-4670-baf4-fc91b63121bb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1366 microversion: 2.1 time: 0.286109 Aug 29 19:15:52.266396 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 534/1075] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:51 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:53.276746 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dc6d6b50-50e6-4b24-a477-505fefedbeb9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:53.278404 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dc6d6b50-50e6-4b24-a477-505fefedbeb9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:53.291067 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c609751d-3d1c-4238-bfaa-22d7fe566631 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:53.292466 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c609751d-3d1c-4238-bfaa-22d7fe566631 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:53.303239 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c609751d-3d1c-4238-bfaa-22d7fe566631 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:53.303651 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc6d6b50-50e6-4b24-a477-505fefedbeb9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:53.304385 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc6d6b50-50e6-4b24-a477-505fefedbeb9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:53.305121 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c609751d-3d1c-4238-bfaa-22d7fe566631 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:53.307414 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c609751d-3d1c-4238-bfaa-22d7fe566631 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:53.307779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc6d6b50-50e6-4b24-a477-505fefedbeb9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:53.309824 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c609751d-3d1c-4238-bfaa-22d7fe566631 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:53.310428 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc6d6b50-50e6-4b24-a477-505fefedbeb9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:53.311152 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc6d6b50-50e6-4b24-a477-505fefedbeb9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:53.311837 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c609751d-3d1c-4238-bfaa-22d7fe566631 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:53.312524 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc6d6b50-50e6-4b24-a477-505fefedbeb9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:53.313187 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c609751d-3d1c-4238-bfaa-22d7fe566631 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:53.819229 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c609751d-3d1c-4238-bfaa-22d7fe566631 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:53.825057 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dc6d6b50-50e6-4b24-a477-505fefedbeb9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:53.834855 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c609751d-3d1c-4238-bfaa-22d7fe566631 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1366 microversion: 2.1 time: 0.548962 Aug 29 19:15:53.835721 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 535/1076] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:53 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1366 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:15:53.836387 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dc6d6b50-50e6-4b24-a477-505fefedbeb9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1575 microversion: 2.1 time: 0.563759 Aug 29 19:15:53.837384 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 542/1077] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:53 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1575 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:54.858954 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ead72c68-a9e2-4fc5-aa9f-d5bba9baf9ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:54.859611 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ead72c68-a9e2-4fc5-aa9f-d5bba9baf9ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:54.861582 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:54.866099 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a4544c37-6a06-4902-85cd-f16401d8854e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:54.868259 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a4544c37-6a06-4902-85cd-f16401d8854e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:54.875637 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:54.877270 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4544c37-6a06-4902-85cd-f16401d8854e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:54.878075 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4544c37-6a06-4902-85cd-f16401d8854e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:54.878540 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ead72c68-a9e2-4fc5-aa9f-d5bba9baf9ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:54.878892 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4544c37-6a06-4902-85cd-f16401d8854e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:54.879262 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ead72c68-a9e2-4fc5-aa9f-d5bba9baf9ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:54.879891 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ead72c68-a9e2-4fc5-aa9f-d5bba9baf9ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:54.880152 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4544c37-6a06-4902-85cd-f16401d8854e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:54.880876 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ead72c68-a9e2-4fc5-aa9f-d5bba9baf9ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:54.881066 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4544c37-6a06-4902-85cd-f16401d8854e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:54.881476 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ead72c68-a9e2-4fc5-aa9f-d5bba9baf9ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:54.881970 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ead72c68-a9e2-4fc5-aa9f-d5bba9baf9ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:54.882179 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4544c37-6a06-4902-85cd-f16401d8854e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:55.180000 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ead72c68-a9e2-4fc5-aa9f-d5bba9baf9ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:55.180654 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a4544c37-6a06-4902-85cd-f16401d8854e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:55.201845 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ead72c68-a9e2-4fc5-aa9f-d5bba9baf9ae tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1366 microversion: 2.1 time: 0.349185 Aug 29 19:15:55.204512 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 536/1078] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:54 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:55.205254 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a4544c37-6a06-4902-85cd-f16401d8854e tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1575 microversion: 2.1 time: 0.349658 Aug 29 19:15:55.205909 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 543/1079] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:54 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1575 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:55.756323 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-8683c96d-5363-4ee0-bb42-29f1f11b75d1 req-90d14545-7df1-4362-9ab0-e41109825f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a07a4d70-1d0f-41b3-8efe-69013ee7ec85", "name": "network-vif-plugged", "status": "completed", "tag": "a2bccc09-69fb-48ef-8907-f73cacf5fbdd"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:55.779108 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8683c96d-5363-4ee0-bb42-29f1f11b75d1 req-90d14545-7df1-4362-9ab0-e41109825f43 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:55.780675 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8683c96d-5363-4ee0-bb42-29f1f11b75d1 req-90d14545-7df1-4362-9ab0-e41109825f43 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:55.782072 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8683c96d-5363-4ee0-bb42-29f1f11b75d1 req-90d14545-7df1-4362-9ab0-e41109825f43 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:55.802017 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-8683c96d-5363-4ee0-bb42-29f1f11b75d1 req-90d14545-7df1-4362-9ab0-e41109825f43 service nova] Creating event network-vif-plugged:a2bccc09-69fb-48ef-8907-f73cacf5fbdd for instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 on hv-cinder-85083 Aug 29 19:15:55.812879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-8683c96d-5363-4ee0-bb42-29f1f11b75d1 req-90d14545-7df1-4362-9ab0-e41109825f43 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057753 Aug 29 19:15:55.814780 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 537/1080] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:56.226975 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dabaee06-c1bf-4245-a622-980e1d956f76 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:56.229188 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dabaee06-c1bf-4245-a622-980e1d956f76 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:56.229651 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5cce8df6-ced5-4108-bff7-2401ee9645f5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:56.232176 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5cce8df6-ced5-4108-bff7-2401ee9645f5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:56.239389 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dabaee06-c1bf-4245-a622-980e1d956f76 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:56.240213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dabaee06-c1bf-4245-a622-980e1d956f76 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:56.241104 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dabaee06-c1bf-4245-a622-980e1d956f76 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:56.241626 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5cce8df6-ced5-4108-bff7-2401ee9645f5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:56.242216 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5cce8df6-ced5-4108-bff7-2401ee9645f5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:56.242423 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dabaee06-c1bf-4245-a622-980e1d956f76 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:56.242836 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5cce8df6-ced5-4108-bff7-2401ee9645f5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:56.243246 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dabaee06-c1bf-4245-a622-980e1d956f76 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:56.243786 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5cce8df6-ced5-4108-bff7-2401ee9645f5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:56.244241 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dabaee06-c1bf-4245-a622-980e1d956f76 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:56.244476 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5cce8df6-ced5-4108-bff7-2401ee9645f5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:56.245190 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5cce8df6-ced5-4108-bff7-2401ee9645f5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:56.475327 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5cce8df6-ced5-4108-bff7-2401ee9645f5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:56.479453 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dabaee06-c1bf-4245-a622-980e1d956f76 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:56.483747 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5cce8df6-ced5-4108-bff7-2401ee9645f5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1366 microversion: 2.1 time: 0.260168 Aug 29 19:15:56.484746 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 538/1081] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:56 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:56.493903 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dabaee06-c1bf-4245-a622-980e1d956f76 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1575 microversion: 2.1 time: 0.271114 Aug 29 19:15:56.496173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 544/1082] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:56 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1575 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:57.518778 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d2fd3b30-170d-4c72-b3a0-26a5affb653d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:57.519367 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d2fd3b30-170d-4c72-b3a0-26a5affb653d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:57.520472 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-98bd58ba-b922-4985-9793-a0d3bcff8d10 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:57.521244 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-98bd58ba-b922-4985-9793-a0d3bcff8d10 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:57.525565 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2fd3b30-170d-4c72-b3a0-26a5affb653d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:57.526106 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2fd3b30-170d-4c72-b3a0-26a5affb653d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:57.526539 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2fd3b30-170d-4c72-b3a0-26a5affb653d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:57.527261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2fd3b30-170d-4c72-b3a0-26a5affb653d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:57.527702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2fd3b30-170d-4c72-b3a0-26a5affb653d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:57.528307 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2fd3b30-170d-4c72-b3a0-26a5affb653d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:57.530593 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98bd58ba-b922-4985-9793-a0d3bcff8d10 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:57.532027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98bd58ba-b922-4985-9793-a0d3bcff8d10 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:57.532751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98bd58ba-b922-4985-9793-a0d3bcff8d10 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:57.533748 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98bd58ba-b922-4985-9793-a0d3bcff8d10 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:57.534443 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98bd58ba-b922-4985-9793-a0d3bcff8d10 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:57.535187 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98bd58ba-b922-4985-9793-a0d3bcff8d10 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:57.781365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d2fd3b30-170d-4c72-b3a0-26a5affb653d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:57.787950 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-98bd58ba-b922-4985-9793-a0d3bcff8d10 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:57.792689 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d2fd3b30-170d-4c72-b3a0-26a5affb653d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1366 microversion: 2.1 time: 0.277833 Aug 29 19:15:57.799722 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 539/1083] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:57 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:57.809866 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-98bd58ba-b922-4985-9793-a0d3bcff8d10 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1575 microversion: 2.1 time: 0.294567 Aug 29 19:15:57.810792 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 545/1084] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:57 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1575 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:15:58.829016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-06f3ed57-d5b8-40e7-b5ea-c70f19e350c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:58.830847 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-06f3ed57-d5b8-40e7-b5ea-c70f19e350c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:58.838155 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b9b5ed4e-5038-4996-952a-e5761d013599 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:58.838753 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06f3ed57-d5b8-40e7-b5ea-c70f19e350c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:58.839031 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06f3ed57-d5b8-40e7-b5ea-c70f19e350c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:58.839707 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06f3ed57-d5b8-40e7-b5ea-c70f19e350c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:58.840481 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b9b5ed4e-5038-4996-952a-e5761d013599 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:58.840928 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06f3ed57-d5b8-40e7-b5ea-c70f19e350c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:58.841397 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06f3ed57-d5b8-40e7-b5ea-c70f19e350c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:58.841831 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06f3ed57-d5b8-40e7-b5ea-c70f19e350c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:58.850834 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b9b5ed4e-5038-4996-952a-e5761d013599 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:58.851922 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b9b5ed4e-5038-4996-952a-e5761d013599 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:58.852764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b9b5ed4e-5038-4996-952a-e5761d013599 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:58.854087 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b9b5ed4e-5038-4996-952a-e5761d013599 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:58.862945 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b9b5ed4e-5038-4996-952a-e5761d013599 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:58.864030 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b9b5ed4e-5038-4996-952a-e5761d013599 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:59.196144 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-06f3ed57-d5b8-40e7-b5ea-c70f19e350c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:59.215083 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-06f3ed57-d5b8-40e7-b5ea-c70f19e350c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1555 microversion: 2.1 time: 0.390188 Aug 29 19:15:59.216629 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 540/1085] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:58 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1555 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:59.237642 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a9effe19-8e0c-414e-bf60-4b6ca521529e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:59.238408 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a9effe19-8e0c-414e-bf60-4b6ca521529e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:59.243253 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b9b5ed4e-5038-4996-952a-e5761d013599 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:59.247762 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a9effe19-8e0c-414e-bf60-4b6ca521529e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:59.249181 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a9effe19-8e0c-414e-bf60-4b6ca521529e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:59.249939 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a9effe19-8e0c-414e-bf60-4b6ca521529e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:59.251636 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a9effe19-8e0c-414e-bf60-4b6ca521529e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:59.252938 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a9effe19-8e0c-414e-bf60-4b6ca521529e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:59.253594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a9effe19-8e0c-414e-bf60-4b6ca521529e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:59.255968 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b9b5ed4e-5038-4996-952a-e5761d013599 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1575 microversion: 2.1 time: 0.423393 Aug 29 19:15:59.256544 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 546/1086] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:58 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1575 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:59.626036 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a9effe19-8e0c-414e-bf60-4b6ca521529e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.392699 Aug 29 19:15:59.626932 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 541/1087] 10.222.0.86 () {58 vars in 1275 bytes} [Mon Aug 29 19:15:59 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85/os-interface => generated 284 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:16:00.278812 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7ef53c1f-4bb6-4b50-b036-550e9459d1a9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:00.279467 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7ef53c1f-4bb6-4b50-b036-550e9459d1a9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:00.291730 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ef53c1f-4bb6-4b50-b036-550e9459d1a9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:00.292230 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ef53c1f-4bb6-4b50-b036-550e9459d1a9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:00.292664 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ef53c1f-4bb6-4b50-b036-550e9459d1a9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:00.293374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ef53c1f-4bb6-4b50-b036-550e9459d1a9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:00.293824 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ef53c1f-4bb6-4b50-b036-550e9459d1a9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:00.294245 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7ef53c1f-4bb6-4b50-b036-550e9459d1a9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:00.731257 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7ef53c1f-4bb6-4b50-b036-550e9459d1a9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:00.740848 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7ef53c1f-4bb6-4b50-b036-550e9459d1a9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1575 microversion: 2.1 time: 0.467160 Aug 29 19:16:00.745602 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 547/1088] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:00 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1575 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:01.015944 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-68a158b7-9b4c-4319-b054-0f74bcbf663d req-e8455173-03b8-4f44-89ec-6af18d4afc64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a07a4d70-1d0f-41b3-8efe-69013ee7ec85", "tag": "a2bccc09-69fb-48ef-8907-f73cacf5fbdd"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:16:01.030678 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-68a158b7-9b4c-4319-b054-0f74bcbf663d req-e8455173-03b8-4f44-89ec-6af18d4afc64 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:01.031424 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-68a158b7-9b4c-4319-b054-0f74bcbf663d req-e8455173-03b8-4f44-89ec-6af18d4afc64 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:01.033025 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-68a158b7-9b4c-4319-b054-0f74bcbf663d req-e8455173-03b8-4f44-89ec-6af18d4afc64 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:01.051026 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-68a158b7-9b4c-4319-b054-0f74bcbf663d req-e8455173-03b8-4f44-89ec-6af18d4afc64 service nova] Creating event network-changed:a2bccc09-69fb-48ef-8907-f73cacf5fbdd for instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 on hv-cinder-85083 Aug 29 19:16:01.059023 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-68a158b7-9b4c-4319-b054-0f74bcbf663d req-e8455173-03b8-4f44-89ec-6af18d4afc64 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048784 Aug 29 19:16:01.064906 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 542/1089] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:16:01.768368 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ab975377-a3e0-47de-871a-87d178736223 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:01.769432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ab975377-a3e0-47de-871a-87d178736223 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:01.783824 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab975377-a3e0-47de-871a-87d178736223 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:01.786347 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab975377-a3e0-47de-871a-87d178736223 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:01.789060 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab975377-a3e0-47de-871a-87d178736223 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:01.790006 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab975377-a3e0-47de-871a-87d178736223 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:01.791157 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab975377-a3e0-47de-871a-87d178736223 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:01.792829 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab975377-a3e0-47de-871a-87d178736223 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:02.159679 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ab975377-a3e0-47de-871a-87d178736223 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:02.172164 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ab975377-a3e0-47de-871a-87d178736223 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1575 microversion: 2.1 time: 0.408963 Aug 29 19:16:02.172989 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 548/1090] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:01 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1575 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:03.194672 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1389e66a-dd92-477d-92d1-7e1bdfe69252 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:03.195480 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1389e66a-dd92-477d-92d1-7e1bdfe69252 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:03.203272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1389e66a-dd92-477d-92d1-7e1bdfe69252 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:03.204485 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1389e66a-dd92-477d-92d1-7e1bdfe69252 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:03.205289 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1389e66a-dd92-477d-92d1-7e1bdfe69252 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:03.206328 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1389e66a-dd92-477d-92d1-7e1bdfe69252 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:03.207405 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1389e66a-dd92-477d-92d1-7e1bdfe69252 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:03.207588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1389e66a-dd92-477d-92d1-7e1bdfe69252 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:03.389832 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1389e66a-dd92-477d-92d1-7e1bdfe69252 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:03.404748 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1389e66a-dd92-477d-92d1-7e1bdfe69252 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1575 microversion: 2.1 time: 0.214216 Aug 29 19:16:03.406276 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 543/1091] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:03 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1575 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:04.428971 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d4306653-e992-4543-bc04-73bb2d1a1e06 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:04.429698 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d4306653-e992-4543-bc04-73bb2d1a1e06 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:04.444232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4306653-e992-4543-bc04-73bb2d1a1e06 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:04.447937 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4306653-e992-4543-bc04-73bb2d1a1e06 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:04.448898 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4306653-e992-4543-bc04-73bb2d1a1e06 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:04.449909 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4306653-e992-4543-bc04-73bb2d1a1e06 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:04.450549 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4306653-e992-4543-bc04-73bb2d1a1e06 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:04.450984 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4306653-e992-4543-bc04-73bb2d1a1e06 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:04.677167 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d4306653-e992-4543-bc04-73bb2d1a1e06 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:04.694600 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d4306653-e992-4543-bc04-73bb2d1a1e06 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1575 microversion: 2.1 time: 0.270086 Aug 29 19:16:04.694961 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 549/1092] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:04 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1575 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:05.432579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-d8773ce4-55f0-4361-a35f-ce3becf924fc req-88c690f6-3f30-4180-834f-1362df9ad5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd46fd90-e3ac-4556-927a-14ce6c51239e", "name": "network-vif-plugged", "status": "completed", "tag": "7b17bd15-64ac-45c7-b33b-22f23076cf55"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:16:05.442751 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-d8773ce4-55f0-4361-a35f-ce3becf924fc req-88c690f6-3f30-4180-834f-1362df9ad5ae service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:05.443262 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-d8773ce4-55f0-4361-a35f-ce3becf924fc req-88c690f6-3f30-4180-834f-1362df9ad5ae service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:05.443691 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-d8773ce4-55f0-4361-a35f-ce3becf924fc req-88c690f6-3f30-4180-834f-1362df9ad5ae service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:05.457149 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-d8773ce4-55f0-4361-a35f-ce3becf924fc req-88c690f6-3f30-4180-834f-1362df9ad5ae service nova] Creating event network-vif-plugged:7b17bd15-64ac-45c7-b33b-22f23076cf55 for instance dd46fd90-e3ac-4556-927a-14ce6c51239e on hv-cinder-85083 Aug 29 19:16:05.462401 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-d8773ce4-55f0-4361-a35f-ce3becf924fc req-88c690f6-3f30-4180-834f-1362df9ad5ae service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033702 Aug 29 19:16:05.463051 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 544/1093] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:16:05.718369 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7555cfaf-8042-4801-9a78-af0ce8b0982a tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:05.719776 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7555cfaf-8042-4801-9a78-af0ce8b0982a tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:05.726895 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7555cfaf-8042-4801-9a78-af0ce8b0982a tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:05.727669 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7555cfaf-8042-4801-9a78-af0ce8b0982a tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:05.728292 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7555cfaf-8042-4801-9a78-af0ce8b0982a tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:05.729173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7555cfaf-8042-4801-9a78-af0ce8b0982a tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:05.729800 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7555cfaf-8042-4801-9a78-af0ce8b0982a tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:05.730424 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7555cfaf-8042-4801-9a78-af0ce8b0982a tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:05.929478 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7555cfaf-8042-4801-9a78-af0ce8b0982a tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:05.938040 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7555cfaf-8042-4801-9a78-af0ce8b0982a tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1575 microversion: 2.1 time: 0.225279 Aug 29 19:16:05.951243 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 550/1094] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:05 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1575 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:06.961493 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-745ce1fa-538e-49d2-99b2-511e3a1685b5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:06.962198 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-745ce1fa-538e-49d2-99b2-511e3a1685b5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:06.973075 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-745ce1fa-538e-49d2-99b2-511e3a1685b5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:06.976112 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-745ce1fa-538e-49d2-99b2-511e3a1685b5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:06.976750 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-745ce1fa-538e-49d2-99b2-511e3a1685b5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:06.979700 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-745ce1fa-538e-49d2-99b2-511e3a1685b5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:06.980372 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-745ce1fa-538e-49d2-99b2-511e3a1685b5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:06.980982 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-745ce1fa-538e-49d2-99b2-511e3a1685b5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:07.142963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-745ce1fa-538e-49d2-99b2-511e3a1685b5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:07.157339 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-745ce1fa-538e-49d2-99b2-511e3a1685b5 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1575 microversion: 2.1 time: 0.195448 Aug 29 19:16:07.158549 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 545/1095] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:06 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:08.181251 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-48536ff8-c61e-4c47-a199-37fdbde49cd2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:08.181999 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-48536ff8-c61e-4c47-a199-37fdbde49cd2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:08.190072 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48536ff8-c61e-4c47-a199-37fdbde49cd2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:08.191423 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48536ff8-c61e-4c47-a199-37fdbde49cd2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:08.192121 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48536ff8-c61e-4c47-a199-37fdbde49cd2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:08.193756 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48536ff8-c61e-4c47-a199-37fdbde49cd2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:08.194895 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48536ff8-c61e-4c47-a199-37fdbde49cd2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:08.195725 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48536ff8-c61e-4c47-a199-37fdbde49cd2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:08.222324 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:08.378776 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-48536ff8-c61e-4c47-a199-37fdbde49cd2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:08.390342 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-48536ff8-c61e-4c47-a199-37fdbde49cd2 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1562 microversion: 2.1 time: 0.215184 Aug 29 19:16:08.409964 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 551/1096] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:08 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:12.458124 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2fb08a2a-32b1-4ef5-97ca-d8841350dca2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Action: 'create', calling method: .version_select at 0x7fb2b9eb3940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-274731984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAsCQPBP1+2Jwuk8xmWU1BVb4A7Dv70M8fZCdxXTp4Xqr/u+6srstya/yGVlFtqFHrAyUNkR04i0eXvbXTJJP9z3Bj0L2hTsSDqgfQzhJr6N/wQ5I0DQJ9lIw44pyhN8A=="}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:16:12.473722 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-2fb08a2a-32b1-4ef5-97ca-d8841350dca2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Getting quotas for project bd38972fd2dc4dda987f96f0a6aedcc7. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:16:12.477516 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-2fb08a2a-32b1-4ef5-97ca-d8841350dca2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Getting quotas for user a4fe2e98ec3d42ccadd648a53fd7b074 and project bd38972fd2dc4dda987f96f0a6aedcc7. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:16:12.499988 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2fb08a2a-32b1-4ef5-97ca-d8841350dca2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.045645 Aug 29 19:16:12.500594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 546/1097] 10.222.0.86 () {60 vars in 1159 bytes} [Mon Aug 29 19:16:12 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:16:12.550374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1731074404", "imageRef": "f1f709d7-7573-4fb5-b951-310b39f02812", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-274731984", "networks": [{"uuid": "6025b07a-911c-4e17-9704-54adafd73e0c"}]}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:16:12.605497 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] validate_networks() for [('6025b07a-911c-4e17-9704-54adafd73e0c', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:16:12.984572 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:16:12.984992 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:16:12.985493 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:16:12.985894 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:16:12.986325 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:16:12.995207 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:12.995682 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:12.996112 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:12.996909 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:12.997355 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:12.997773 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:13.015536 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Getting quotas for project bd38972fd2dc4dda987f96f0a6aedcc7. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:16:13.019661 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Getting quotas for user a4fe2e98ec3d42ccadd648a53fd7b074 and project bd38972fd2dc4dda987f96f0a6aedcc7. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:16:13.037744 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:16:13.040020 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1f709d7-7573-4fb5-b951-310b39f02812',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:16:13.086392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-65d64e8a-d0cb-4049-9a32-de9b34a7df8d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539772 Aug 29 19:16:13.087115 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 552/1098] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:16:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:16:13.097815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a434ac77-9f29-42ce-8df2-91e7a9d0ec9e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:13.098423 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a434ac77-9f29-42ce-8df2-91e7a9d0ec9e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:13.158374 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a434ac77-9f29-42ce-8df2-91e7a9d0ec9e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:13.167820 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a434ac77-9f29-42ce-8df2-91e7a9d0ec9e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1258 microversion: 2.1 time: 0.072713 Aug 29 19:16:13.168573 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 547/1099] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:13 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:14.189792 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0386bcc8-9929-41ff-a2e2-6215ce6e96b4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:14.190399 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0386bcc8-9929-41ff-a2e2-6215ce6e96b4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:14.197521 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0386bcc8-9929-41ff-a2e2-6215ce6e96b4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:14.198003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0386bcc8-9929-41ff-a2e2-6215ce6e96b4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:14.198432 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0386bcc8-9929-41ff-a2e2-6215ce6e96b4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:14.199173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0386bcc8-9929-41ff-a2e2-6215ce6e96b4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:14.199624 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0386bcc8-9929-41ff-a2e2-6215ce6e96b4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:14.200049 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0386bcc8-9929-41ff-a2e2-6215ce6e96b4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:14.262482 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0386bcc8-9929-41ff-a2e2-6215ce6e96b4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:14.270281 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0386bcc8-9929-41ff-a2e2-6215ce6e96b4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1310 microversion: 2.1 time: 0.084948 Aug 29 19:16:14.270834 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 553/1100] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:14 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:15.295321 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e6838f0f-7a11-4119-8bfa-47e8a4e1d937 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:15.298235 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e6838f0f-7a11-4119-8bfa-47e8a4e1d937 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:15.310520 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6838f0f-7a11-4119-8bfa-47e8a4e1d937 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:15.311028 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6838f0f-7a11-4119-8bfa-47e8a4e1d937 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:15.311661 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6838f0f-7a11-4119-8bfa-47e8a4e1d937 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:15.313254 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6838f0f-7a11-4119-8bfa-47e8a4e1d937 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:15.314113 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6838f0f-7a11-4119-8bfa-47e8a4e1d937 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:15.314926 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6838f0f-7a11-4119-8bfa-47e8a4e1d937 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:15.499114 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e6838f0f-7a11-4119-8bfa-47e8a4e1d937 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:15.508942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e6838f0f-7a11-4119-8bfa-47e8a4e1d937 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.219317 Aug 29 19:16:15.509782 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 548/1101] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:15 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:16.530001 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-740c9b9d-280e-4691-bf19-59ce11b75e23 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:16.530734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-740c9b9d-280e-4691-bf19-59ce11b75e23 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:16.537780 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-740c9b9d-280e-4691-bf19-59ce11b75e23 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:16.538261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-740c9b9d-280e-4691-bf19-59ce11b75e23 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:16.538699 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-740c9b9d-280e-4691-bf19-59ce11b75e23 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:16.539436 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-740c9b9d-280e-4691-bf19-59ce11b75e23 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:16.539892 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-740c9b9d-280e-4691-bf19-59ce11b75e23 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:16.540311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-740c9b9d-280e-4691-bf19-59ce11b75e23 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:16.690697 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-740c9b9d-280e-4691-bf19-59ce11b75e23 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:16.698953 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-740c9b9d-280e-4691-bf19-59ce11b75e23 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.172985 Aug 29 19:16:16.699854 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 554/1102] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:16 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:17.720834 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2b1804eb-60d3-4f4f-b2f1-c10006f9f3ce tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:17.721536 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2b1804eb-60d3-4f4f-b2f1-c10006f9f3ce tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:17.728771 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b1804eb-60d3-4f4f-b2f1-c10006f9f3ce tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:17.729003 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b1804eb-60d3-4f4f-b2f1-c10006f9f3ce tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:17.729451 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b1804eb-60d3-4f4f-b2f1-c10006f9f3ce tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:17.730194 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b1804eb-60d3-4f4f-b2f1-c10006f9f3ce tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:17.730723 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b1804eb-60d3-4f4f-b2f1-c10006f9f3ce tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:17.731302 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b1804eb-60d3-4f4f-b2f1-c10006f9f3ce tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:17.867468 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2b1804eb-60d3-4f4f-b2f1-c10006f9f3ce tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:17.876257 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2b1804eb-60d3-4f4f-b2f1-c10006f9f3ce tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.159521 Aug 29 19:16:17.876840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 549/1103] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:17 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:18.899468 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-01b870c6-470c-40c4-ad8d-c7d3d6497036 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:18.901576 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-01b870c6-470c-40c4-ad8d-c7d3d6497036 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:18.909063 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01b870c6-470c-40c4-ad8d-c7d3d6497036 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:18.909818 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01b870c6-470c-40c4-ad8d-c7d3d6497036 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:18.910267 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01b870c6-470c-40c4-ad8d-c7d3d6497036 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:18.910969 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01b870c6-470c-40c4-ad8d-c7d3d6497036 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:18.911596 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01b870c6-470c-40c4-ad8d-c7d3d6497036 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:18.912039 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01b870c6-470c-40c4-ad8d-c7d3d6497036 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:19.057711 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-01b870c6-470c-40c4-ad8d-c7d3d6497036 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:19.067629 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-01b870c6-470c-40c4-ad8d-c7d3d6497036 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.172497 Aug 29 19:16:19.068784 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 555/1104] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:18 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:20.090784 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5de616ba-f426-451a-949d-8aa61fa8aac2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:20.091456 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5de616ba-f426-451a-949d-8aa61fa8aac2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:20.098100 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5de616ba-f426-451a-949d-8aa61fa8aac2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:20.098582 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5de616ba-f426-451a-949d-8aa61fa8aac2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:20.099023 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5de616ba-f426-451a-949d-8aa61fa8aac2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:20.099939 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5de616ba-f426-451a-949d-8aa61fa8aac2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:20.100364 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5de616ba-f426-451a-949d-8aa61fa8aac2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:20.100777 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5de616ba-f426-451a-949d-8aa61fa8aac2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:20.103799 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=85 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:20.240645 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5de616ba-f426-451a-949d-8aa61fa8aac2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:20.248378 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5de616ba-f426-451a-949d-8aa61fa8aac2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.162151 Aug 29 19:16:20.248935 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 550/1105] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:20 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:21.271560 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-169deec7-11f1-4450-bc55-9787e1352afa tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:21.272695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-169deec7-11f1-4450-bc55-9787e1352afa tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:21.280858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-169deec7-11f1-4450-bc55-9787e1352afa tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:21.280858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-169deec7-11f1-4450-bc55-9787e1352afa tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:21.281354 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-169deec7-11f1-4450-bc55-9787e1352afa tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:21.281962 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-169deec7-11f1-4450-bc55-9787e1352afa tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:21.282415 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-169deec7-11f1-4450-bc55-9787e1352afa tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:21.287788 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-169deec7-11f1-4450-bc55-9787e1352afa tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:21.421904 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-169deec7-11f1-4450-bc55-9787e1352afa tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:21.431158 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-169deec7-11f1-4450-bc55-9787e1352afa tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.164595 Aug 29 19:16:21.439471 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 556/1106] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:21 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:22.452662 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0d2e61bf-5055-4b8b-a5a7-ddbe08d41ad0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:22.453288 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0d2e61bf-5055-4b8b-a5a7-ddbe08d41ad0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:22.468508 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d2e61bf-5055-4b8b-a5a7-ddbe08d41ad0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:22.468508 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d2e61bf-5055-4b8b-a5a7-ddbe08d41ad0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:22.468508 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d2e61bf-5055-4b8b-a5a7-ddbe08d41ad0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:22.468508 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d2e61bf-5055-4b8b-a5a7-ddbe08d41ad0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:22.469076 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d2e61bf-5055-4b8b-a5a7-ddbe08d41ad0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:22.469076 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d2e61bf-5055-4b8b-a5a7-ddbe08d41ad0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:22.601163 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0d2e61bf-5055-4b8b-a5a7-ddbe08d41ad0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:22.609655 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0d2e61bf-5055-4b8b-a5a7-ddbe08d41ad0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.161171 Aug 29 19:16:22.610255 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 551/1107] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:22 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:23.631069 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a4a5c66c-10fe-49ed-8332-f0adda263456 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:23.632513 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a4a5c66c-10fe-49ed-8332-f0adda263456 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:23.636240 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:23.637434 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=6 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:23.650055 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4a5c66c-10fe-49ed-8332-f0adda263456 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:23.650055 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4a5c66c-10fe-49ed-8332-f0adda263456 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:23.650055 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4a5c66c-10fe-49ed-8332-f0adda263456 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:23.650055 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4a5c66c-10fe-49ed-8332-f0adda263456 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:23.650656 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4a5c66c-10fe-49ed-8332-f0adda263456 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:23.650656 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4a5c66c-10fe-49ed-8332-f0adda263456 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:23.788973 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a4a5c66c-10fe-49ed-8332-f0adda263456 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:23.796624 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a4a5c66c-10fe-49ed-8332-f0adda263456 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.169649 Aug 29 19:16:23.797400 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 557/1108] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:23 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:24.818822 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d5fe0943-8cc6-4cdb-b4b5-ca62bca4ad20 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:24.819458 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d5fe0943-8cc6-4cdb-b4b5-ca62bca4ad20 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:24.821389 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:24.826883 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5fe0943-8cc6-4cdb-b4b5-ca62bca4ad20 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:24.827815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5fe0943-8cc6-4cdb-b4b5-ca62bca4ad20 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:24.828379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5fe0943-8cc6-4cdb-b4b5-ca62bca4ad20 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:24.829287 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5fe0943-8cc6-4cdb-b4b5-ca62bca4ad20 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:24.829738 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5fe0943-8cc6-4cdb-b4b5-ca62bca4ad20 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:24.830162 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5fe0943-8cc6-4cdb-b4b5-ca62bca4ad20 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:24.957711 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d5fe0943-8cc6-4cdb-b4b5-ca62bca4ad20 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:24.965374 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d5fe0943-8cc6-4cdb-b4b5-ca62bca4ad20 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.150387 Aug 29 19:16:24.965929 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 552/1109] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:24 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:25.986486 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-81349556-a353-46d6-9322-a663223d903f tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:25.987079 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-81349556-a353-46d6-9322-a663223d903f tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:25.989407 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:25.994253 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81349556-a353-46d6-9322-a663223d903f tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:25.994735 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81349556-a353-46d6-9322-a663223d903f tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:25.995374 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81349556-a353-46d6-9322-a663223d903f tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:25.996082 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81349556-a353-46d6-9322-a663223d903f tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:25.996536 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81349556-a353-46d6-9322-a663223d903f tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:25.996962 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81349556-a353-46d6-9322-a663223d903f tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:26.123614 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-81349556-a353-46d6-9322-a663223d903f tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:26.131133 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-81349556-a353-46d6-9322-a663223d903f tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.149131 Aug 29 19:16:26.131701 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 558/1110] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:25 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:27.152010 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-839c8a2c-97f2-46d4-9159-3e7e5af1c96e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:27.152626 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-839c8a2c-97f2-46d4-9159-3e7e5af1c96e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:27.155290 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:27.162060 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-839c8a2c-97f2-46d4-9159-3e7e5af1c96e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:27.162542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-839c8a2c-97f2-46d4-9159-3e7e5af1c96e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:27.162973 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-839c8a2c-97f2-46d4-9159-3e7e5af1c96e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:27.163730 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-839c8a2c-97f2-46d4-9159-3e7e5af1c96e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:27.164181 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-839c8a2c-97f2-46d4-9159-3e7e5af1c96e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:27.164598 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-839c8a2c-97f2-46d4-9159-3e7e5af1c96e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:27.304600 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-839c8a2c-97f2-46d4-9159-3e7e5af1c96e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:27.312650 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-839c8a2c-97f2-46d4-9159-3e7e5af1c96e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.164827 Aug 29 19:16:27.313228 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 553/1111] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:27 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:28.333393 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-356855c7-9ce4-4240-93dc-61d12af7f290 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:28.334000 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-356855c7-9ce4-4240-93dc-61d12af7f290 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:28.340600 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-356855c7-9ce4-4240-93dc-61d12af7f290 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:28.341089 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-356855c7-9ce4-4240-93dc-61d12af7f290 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:28.341525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-356855c7-9ce4-4240-93dc-61d12af7f290 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:28.342229 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-356855c7-9ce4-4240-93dc-61d12af7f290 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:28.342682 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-356855c7-9ce4-4240-93dc-61d12af7f290 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:28.344025 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-356855c7-9ce4-4240-93dc-61d12af7f290 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:28.573906 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-356855c7-9ce4-4240-93dc-61d12af7f290 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:28.582017 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-356855c7-9ce4-4240-93dc-61d12af7f290 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.252526 Aug 29 19:16:28.582585 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 559/1112] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:28 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:28.896987 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-ba344ada-360d-499b-9ff3-54283c0b5298 req-7d069a5e-097b-4fca-9a0e-5b5ea65797ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c19eb73-18d8-490f-94c9-c77d13a60777", "tag": "faa670fa-8772-41df-9969-225d0abc3e7f"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:16:28.907395 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ba344ada-360d-499b-9ff3-54283c0b5298 req-7d069a5e-097b-4fca-9a0e-5b5ea65797ac service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:28.907928 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ba344ada-360d-499b-9ff3-54283c0b5298 req-7d069a5e-097b-4fca-9a0e-5b5ea65797ac service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:28.908308 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ba344ada-360d-499b-9ff3-54283c0b5298 req-7d069a5e-097b-4fca-9a0e-5b5ea65797ac service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:28.919558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-ba344ada-360d-499b-9ff3-54283c0b5298 req-7d069a5e-097b-4fca-9a0e-5b5ea65797ac service nova] Creating event network-changed:faa670fa-8772-41df-9969-225d0abc3e7f for instance 2c19eb73-18d8-490f-94c9-c77d13a60777 on hv-cinder-85083 Aug 29 19:16:28.924399 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-ba344ada-360d-499b-9ff3-54283c0b5298 req-7d069a5e-097b-4fca-9a0e-5b5ea65797ac service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031130 Aug 29 19:16:28.925547 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 554/1113] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:16:29.603080 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c6252cb8-8b5d-4ab3-8574-c0959a1dc1c3 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:29.603864 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c6252cb8-8b5d-4ab3-8574-c0959a1dc1c3 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:29.610961 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c6252cb8-8b5d-4ab3-8574-c0959a1dc1c3 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:29.611480 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c6252cb8-8b5d-4ab3-8574-c0959a1dc1c3 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:29.611922 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c6252cb8-8b5d-4ab3-8574-c0959a1dc1c3 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:29.612615 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c6252cb8-8b5d-4ab3-8574-c0959a1dc1c3 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:29.613078 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c6252cb8-8b5d-4ab3-8574-c0959a1dc1c3 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:29.613505 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c6252cb8-8b5d-4ab3-8574-c0959a1dc1c3 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:29.778285 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c6252cb8-8b5d-4ab3-8574-c0959a1dc1c3 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:29.787440 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c6252cb8-8b5d-4ab3-8574-c0959a1dc1c3 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.188297 Aug 29 19:16:29.788014 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 560/1114] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:29 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:30.809889 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d5a293e1-3752-4473-b9ac-49d2b679e8e8 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:30.810582 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d5a293e1-3752-4473-b9ac-49d2b679e8e8 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:30.816815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5a293e1-3752-4473-b9ac-49d2b679e8e8 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:30.817298 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5a293e1-3752-4473-b9ac-49d2b679e8e8 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:30.817733 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5a293e1-3752-4473-b9ac-49d2b679e8e8 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:30.818420 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5a293e1-3752-4473-b9ac-49d2b679e8e8 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:30.818874 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5a293e1-3752-4473-b9ac-49d2b679e8e8 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:30.819329 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5a293e1-3752-4473-b9ac-49d2b679e8e8 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:30.946060 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d5a293e1-3752-4473-b9ac-49d2b679e8e8 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:30.954470 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d5a293e1-3752-4473-b9ac-49d2b679e8e8 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.149570 Aug 29 19:16:30.955047 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 555/1115] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:30 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:31.974818 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a31403d9-a386-4075-bb4a-1dfce55f4f51 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:31.975375 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a31403d9-a386-4075-bb4a-1dfce55f4f51 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:31.981507 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a31403d9-a386-4075-bb4a-1dfce55f4f51 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:31.981990 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a31403d9-a386-4075-bb4a-1dfce55f4f51 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:31.982430 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a31403d9-a386-4075-bb4a-1dfce55f4f51 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:31.983151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a31403d9-a386-4075-bb4a-1dfce55f4f51 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:31.983608 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a31403d9-a386-4075-bb4a-1dfce55f4f51 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:31.984064 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a31403d9-a386-4075-bb4a-1dfce55f4f51 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:32.113038 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a31403d9-a386-4075-bb4a-1dfce55f4f51 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:32.120761 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a31403d9-a386-4075-bb4a-1dfce55f4f51 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.149916 Aug 29 19:16:32.121330 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 561/1116] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:31 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:33.142256 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-81a000f6-e905-40bf-bff4-e5be1ff341ab tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:33.142862 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-81a000f6-e905-40bf-bff4-e5be1ff341ab tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:33.149376 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81a000f6-e905-40bf-bff4-e5be1ff341ab tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:33.149856 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81a000f6-e905-40bf-bff4-e5be1ff341ab tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:33.150286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81a000f6-e905-40bf-bff4-e5be1ff341ab tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:33.151026 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81a000f6-e905-40bf-bff4-e5be1ff341ab tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:33.151462 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81a000f6-e905-40bf-bff4-e5be1ff341ab tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:33.151883 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81a000f6-e905-40bf-bff4-e5be1ff341ab tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:33.278668 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-81a000f6-e905-40bf-bff4-e5be1ff341ab tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:33.286891 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-81a000f6-e905-40bf-bff4-e5be1ff341ab tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.149220 Aug 29 19:16:33.287494 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 556/1117] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:33 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:34.307510 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ea7c9c4c-79dc-4894-afed-4bf164a8d646 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:34.308120 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ea7c9c4c-79dc-4894-afed-4bf164a8d646 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:34.314623 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea7c9c4c-79dc-4894-afed-4bf164a8d646 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:34.315140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea7c9c4c-79dc-4894-afed-4bf164a8d646 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:34.315579 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea7c9c4c-79dc-4894-afed-4bf164a8d646 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:34.316267 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea7c9c4c-79dc-4894-afed-4bf164a8d646 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:34.316720 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea7c9c4c-79dc-4894-afed-4bf164a8d646 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:34.317148 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea7c9c4c-79dc-4894-afed-4bf164a8d646 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:34.448203 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ea7c9c4c-79dc-4894-afed-4bf164a8d646 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:34.456651 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ea7c9c4c-79dc-4894-afed-4bf164a8d646 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.153152 Aug 29 19:16:34.457213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 562/1118] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:34 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:16:35.477606 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-dfcfb8cf-ef7c-41a0-bc1b-f4a8f27ea2a9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:35.478222 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-dfcfb8cf-ef7c-41a0-bc1b-f4a8f27ea2a9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:35.485859 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dfcfb8cf-ef7c-41a0-bc1b-f4a8f27ea2a9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:35.486272 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dfcfb8cf-ef7c-41a0-bc1b-f4a8f27ea2a9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:35.486723 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dfcfb8cf-ef7c-41a0-bc1b-f4a8f27ea2a9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:35.487457 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dfcfb8cf-ef7c-41a0-bc1b-f4a8f27ea2a9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:35.487914 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dfcfb8cf-ef7c-41a0-bc1b-f4a8f27ea2a9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:35.488336 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dfcfb8cf-ef7c-41a0-bc1b-f4a8f27ea2a9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:35.621208 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-dfcfb8cf-ef7c-41a0-bc1b-f4a8f27ea2a9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:35.628806 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-dfcfb8cf-ef7c-41a0-bc1b-f4a8f27ea2a9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.155107 Aug 29 19:16:35.629373 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 557/1119] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:35 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:36.649543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-851daece-8883-4cb4-abce-5b65a7c788dd tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:36.650098 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-851daece-8883-4cb4-abce-5b65a7c788dd tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:36.656548 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-851daece-8883-4cb4-abce-5b65a7c788dd tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:36.657692 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-851daece-8883-4cb4-abce-5b65a7c788dd tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:36.658126 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-851daece-8883-4cb4-abce-5b65a7c788dd tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:36.658814 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-851daece-8883-4cb4-abce-5b65a7c788dd tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:36.659290 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-851daece-8883-4cb4-abce-5b65a7c788dd tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:36.659718 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-851daece-8883-4cb4-abce-5b65a7c788dd tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:36.787948 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-851daece-8883-4cb4-abce-5b65a7c788dd tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:36.795423 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-851daece-8883-4cb4-abce-5b65a7c788dd tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.149824 Aug 29 19:16:36.795987 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 563/1120] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:36 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:37.604053 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-49f1bcf5-a769-419f-8c32-6ef413ea055e req-a7c8fbf7-6e7f-49d8-9cb6-8ac142d01601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c19eb73-18d8-490f-94c9-c77d13a60777", "name": "network-vif-plugged", "status": "completed", "tag": "faa670fa-8772-41df-9969-225d0abc3e7f"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:16:37.614890 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-49f1bcf5-a769-419f-8c32-6ef413ea055e req-a7c8fbf7-6e7f-49d8-9cb6-8ac142d01601 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:37.615717 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-49f1bcf5-a769-419f-8c32-6ef413ea055e req-a7c8fbf7-6e7f-49d8-9cb6-8ac142d01601 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:37.615868 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-49f1bcf5-a769-419f-8c32-6ef413ea055e req-a7c8fbf7-6e7f-49d8-9cb6-8ac142d01601 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:37.628140 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-49f1bcf5-a769-419f-8c32-6ef413ea055e req-a7c8fbf7-6e7f-49d8-9cb6-8ac142d01601 service nova] Creating event network-vif-plugged:faa670fa-8772-41df-9969-225d0abc3e7f for instance 2c19eb73-18d8-490f-94c9-c77d13a60777 on hv-cinder-85083 Aug 29 19:16:37.633004 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-49f1bcf5-a769-419f-8c32-6ef413ea055e req-a7c8fbf7-6e7f-49d8-9cb6-8ac142d01601 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032685 Aug 29 19:16:37.633594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 558/1121] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:16:37.816411 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e3c1c674-8285-4aab-8b63-8c399d66b13e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:37.817047 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e3c1c674-8285-4aab-8b63-8c399d66b13e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:37.823772 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e3c1c674-8285-4aab-8b63-8c399d66b13e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:37.824248 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e3c1c674-8285-4aab-8b63-8c399d66b13e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:37.824674 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e3c1c674-8285-4aab-8b63-8c399d66b13e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:37.825363 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e3c1c674-8285-4aab-8b63-8c399d66b13e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:37.825815 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e3c1c674-8285-4aab-8b63-8c399d66b13e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:37.826231 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e3c1c674-8285-4aab-8b63-8c399d66b13e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:37.988713 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e3c1c674-8285-4aab-8b63-8c399d66b13e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:37.996253 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e3c1c674-8285-4aab-8b63-8c399d66b13e tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.184125 Aug 29 19:16:37.996816 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 564/1122] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:37 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:39.017866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-aab50d2e-5c72-498e-937d-cd7171fe6241 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:39.018558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-aab50d2e-5c72-498e-937d-cd7171fe6241 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:39.024720 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-aab50d2e-5c72-498e-937d-cd7171fe6241 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:39.025190 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-aab50d2e-5c72-498e-937d-cd7171fe6241 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:39.025614 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-aab50d2e-5c72-498e-937d-cd7171fe6241 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:39.026286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-aab50d2e-5c72-498e-937d-cd7171fe6241 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:39.026733 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-aab50d2e-5c72-498e-937d-cd7171fe6241 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:39.027178 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-aab50d2e-5c72-498e-937d-cd7171fe6241 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:39.306941 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-aab50d2e-5c72-498e-937d-cd7171fe6241 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:39.314554 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-aab50d2e-5c72-498e-937d-cd7171fe6241 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.301854 Aug 29 19:16:39.315138 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 559/1123] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:39 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:40.335706 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-349a50a2-80eb-4615-a36d-2c91ae42fdae tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:40.336297 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-349a50a2-80eb-4615-a36d-2c91ae42fdae tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:40.344140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-349a50a2-80eb-4615-a36d-2c91ae42fdae tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:40.344647 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-349a50a2-80eb-4615-a36d-2c91ae42fdae tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:40.345080 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-349a50a2-80eb-4615-a36d-2c91ae42fdae tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:40.345810 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-349a50a2-80eb-4615-a36d-2c91ae42fdae tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:40.346507 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-349a50a2-80eb-4615-a36d-2c91ae42fdae tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:40.346965 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-349a50a2-80eb-4615-a36d-2c91ae42fdae tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:40.352814 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=79 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:40.537595 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-349a50a2-80eb-4615-a36d-2c91ae42fdae tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:40.545378 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-349a50a2-80eb-4615-a36d-2c91ae42fdae tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1358 microversion: 2.1 time: 0.213526 Aug 29 19:16:40.545944 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 565/1124] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:40 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:41.566003 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6745fdf5-8f94-41a7-84af-c8f35f7d0656 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:41.566652 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6745fdf5-8f94-41a7-84af-c8f35f7d0656 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:41.573226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6745fdf5-8f94-41a7-84af-c8f35f7d0656 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:41.573704 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6745fdf5-8f94-41a7-84af-c8f35f7d0656 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:41.574131 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6745fdf5-8f94-41a7-84af-c8f35f7d0656 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:41.574809 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6745fdf5-8f94-41a7-84af-c8f35f7d0656 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:41.575278 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6745fdf5-8f94-41a7-84af-c8f35f7d0656 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:41.575698 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6745fdf5-8f94-41a7-84af-c8f35f7d0656 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:41.701531 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6745fdf5-8f94-41a7-84af-c8f35f7d0656 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:41.709553 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6745fdf5-8f94-41a7-84af-c8f35f7d0656 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1547 microversion: 2.1 time: 0.147657 Aug 29 19:16:41.710115 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 560/1125] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:41 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:41.729841 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-018bca2a-5d98-434c-a5c8-fe0203b8729b tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:41.730463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-018bca2a-5d98-434c-a5c8-fe0203b8729b tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:41.737543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-018bca2a-5d98-434c-a5c8-fe0203b8729b tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:41.738025 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-018bca2a-5d98-434c-a5c8-fe0203b8729b tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:41.738467 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-018bca2a-5d98-434c-a5c8-fe0203b8729b tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:41.739197 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-018bca2a-5d98-434c-a5c8-fe0203b8729b tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:41.739651 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-018bca2a-5d98-434c-a5c8-fe0203b8729b tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:41.740078 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-018bca2a-5d98-434c-a5c8-fe0203b8729b tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:41.872714 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-018bca2a-5d98-434c-a5c8-fe0203b8729b tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:41.880334 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-018bca2a-5d98-434c-a5c8-fe0203b8729b tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1547 microversion: 2.1 time: 0.154401 Aug 29 19:16:41.880895 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 566/1126] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:41 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:41.900089 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-66f2cc41-b28d-48f2-843c-1d266e295133 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:41.904855 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-66f2cc41-b28d-48f2-843c-1d266e295133 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:41.905616 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-66f2cc41-b28d-48f2-843c-1d266e295133 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Searching by: {'deleted': False, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7'} {{(pid=120708) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 19:16:41.912810 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-66f2cc41-b28d-48f2-843c-1d266e295133 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:41.913285 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-66f2cc41-b28d-48f2-843c-1d266e295133 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:41.913714 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-66f2cc41-b28d-48f2-843c-1d266e295133 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:41.914437 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-66f2cc41-b28d-48f2-843c-1d266e295133 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:41.914887 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-66f2cc41-b28d-48f2-843c-1d266e295133 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:41.915350 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-66f2cc41-b28d-48f2-843c-1d266e295133 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:42.003607 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.multi_cell_list [None req-66f2cc41-b28d-48f2-843c-1d266e295133 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120708) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 19:16:42.099572 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-66f2cc41-b28d-48f2-843c-1d266e295133 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203039 Aug 29 19:16:42.100073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 561/1127] 10.222.0.86 () {58 vars in 1125 bytes} [Mon Aug 29 19:16:41 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:16:42.111368 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-03cbf355-b18d-4b34-8708-8178775abf88 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:42.111976 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-03cbf355-b18d-4b34-8708-8178775abf88 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:42.118249 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-03cbf355-b18d-4b34-8708-8178775abf88 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:42.118738 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-03cbf355-b18d-4b34-8708-8178775abf88 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:42.119217 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-03cbf355-b18d-4b34-8708-8178775abf88 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:42.119915 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-03cbf355-b18d-4b34-8708-8178775abf88 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:42.120365 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-03cbf355-b18d-4b34-8708-8178775abf88 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:42.120785 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-03cbf355-b18d-4b34-8708-8178775abf88 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:42.253651 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-03cbf355-b18d-4b34-8708-8178775abf88 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:42.262251 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-03cbf355-b18d-4b34-8708-8178775abf88 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1547 microversion: 2.1 time: 0.154685 Aug 29 19:16:42.262830 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 567/1128] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:42 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:44.852491 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ef0f20b7-7272-4985-8fe5-cb98e8593ffe tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "108394ac-5726-4211-9350-19cadeebab0f"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:16:44.854773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ef0f20b7-7272-4985-8fe5-cb98e8593ffe tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:44.861994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef0f20b7-7272-4985-8fe5-cb98e8593ffe tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:44.862476 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef0f20b7-7272-4985-8fe5-cb98e8593ffe tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:44.862912 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef0f20b7-7272-4985-8fe5-cb98e8593ffe tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:44.863661 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef0f20b7-7272-4985-8fe5-cb98e8593ffe tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:44.864120 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef0f20b7-7272-4985-8fe5-cb98e8593ffe tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:44.864546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef0f20b7-7272-4985-8fe5-cb98e8593ffe tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:45.158919 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ef0f20b7-7272-4985-8fe5-cb98e8593ffe tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "POST /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310127 Aug 29 19:16:45.159525 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 562/1129] 10.222.0.86 () {60 vars in 1323 bytes} [Mon Aug 29 19:16:44 2022] POST /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:16:52.905154 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b96e4e0d-c3ce-49e9-a39d-4beb4c4001b1 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:52.905762 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b96e4e0d-c3ce-49e9-a39d-4beb4c4001b1 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:52.909325 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=19 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:52.909902 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=17 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:52.914857 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b96e4e0d-c3ce-49e9-a39d-4beb4c4001b1 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:52.915400 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b96e4e0d-c3ce-49e9-a39d-4beb4c4001b1 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:52.915830 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b96e4e0d-c3ce-49e9-a39d-4beb4c4001b1 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:52.916514 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b96e4e0d-c3ce-49e9-a39d-4beb4c4001b1 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:52.916963 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b96e4e0d-c3ce-49e9-a39d-4beb4c4001b1 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:52.917381 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b96e4e0d-c3ce-49e9-a39d-4beb4c4001b1 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:53.046296 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b96e4e0d-c3ce-49e9-a39d-4beb4c4001b1 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:53.054334 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b96e4e0d-c3ce-49e9-a39d-4beb4c4001b1 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1593 microversion: 2.1 time: 0.153020 Aug 29 19:16:53.054888 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 568/1130] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:52 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1593 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:54.954025 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:54.955752 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=19 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:54.959084 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-1965dc6a-021c-4d36-89c8-ac8d17914d0a req-e8f0127a-f1e5-478a-a07e-3eafdad8f70d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c19eb73-18d8-490f-94c9-c77d13a60777", "tag": "faa670fa-8772-41df-9969-225d0abc3e7f"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:16:54.970773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-1965dc6a-021c-4d36-89c8-ac8d17914d0a req-e8f0127a-f1e5-478a-a07e-3eafdad8f70d service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:54.971305 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-1965dc6a-021c-4d36-89c8-ac8d17914d0a req-e8f0127a-f1e5-478a-a07e-3eafdad8f70d service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:54.971751 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-1965dc6a-021c-4d36-89c8-ac8d17914d0a req-e8f0127a-f1e5-478a-a07e-3eafdad8f70d service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:54.976654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:54.984411 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-1965dc6a-021c-4d36-89c8-ac8d17914d0a req-e8f0127a-f1e5-478a-a07e-3eafdad8f70d service nova] Creating event network-changed:faa670fa-8772-41df-9969-225d0abc3e7f for instance 2c19eb73-18d8-490f-94c9-c77d13a60777 on hv-cinder-85083 Aug 29 19:16:54.989635 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-1965dc6a-021c-4d36-89c8-ac8d17914d0a req-e8f0127a-f1e5-478a-a07e-3eafdad8f70d service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037608 Aug 29 19:16:54.990633 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 563/1131] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:16:56.188065 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-041590c2-25e8-4b8d-94f2-bdd78f232005 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-931963232"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:16:56.188682 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-041590c2-25e8-4b8d-94f2-bdd78f232005 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:56.195052 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-041590c2-25e8-4b8d-94f2-bdd78f232005 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:56.195541 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-041590c2-25e8-4b8d-94f2-bdd78f232005 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:56.196012 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-041590c2-25e8-4b8d-94f2-bdd78f232005 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:56.196665 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-041590c2-25e8-4b8d-94f2-bdd78f232005 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:56.197134 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-041590c2-25e8-4b8d-94f2-bdd78f232005 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:56.197538 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-041590c2-25e8-4b8d-94f2-bdd78f232005 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:56.327765 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.network.security_group_api [None req-041590c2-25e8-4b8d-94f2-bdd78f232005 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Adding security group cae303dc-2808-4f23-902b-e1ee8d7e2937 to port faa670fa-8772-41df-9969-225d0abc3e7f Aug 29 19:16:56.641323 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-041590c2-25e8-4b8d-94f2-bdd78f232005 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "POST /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/action" status: 202 len: 0 microversion: 2.1 time: 0.456632 Aug 29 19:16:56.641946 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 569/1132] 10.222.0.86 () {60 vars in 1278 bytes} [Mon Aug 29 19:16:56 2022] POST /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:16:56.654044 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-73ddfe18-ed46-4870-9563-92b3e877c252 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:56.654777 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-73ddfe18-ed46-4870-9563-92b3e877c252 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:56.661625 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73ddfe18-ed46-4870-9563-92b3e877c252 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:56.662091 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73ddfe18-ed46-4870-9563-92b3e877c252 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:56.662528 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73ddfe18-ed46-4870-9563-92b3e877c252 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:56.663282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73ddfe18-ed46-4870-9563-92b3e877c252 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:56.663737 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73ddfe18-ed46-4870-9563-92b3e877c252 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:56.664279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73ddfe18-ed46-4870-9563-92b3e877c252 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:56.819585 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-73ddfe18-ed46-4870-9563-92b3e877c252 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:56.829000 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-73ddfe18-ed46-4870-9563-92b3e877c252 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1758 microversion: 2.1 time: 0.180419 Aug 29 19:16:56.829569 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 564/1133] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:56 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:57.005030 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-2fe777df-d543-46eb-be48-5f563518601d req-9066762f-7bdc-46fb-9817-9a943670bcba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c19eb73-18d8-490f-94c9-c77d13a60777", "tag": "faa670fa-8772-41df-9969-225d0abc3e7f"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:16:57.014535 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2fe777df-d543-46eb-be48-5f563518601d req-9066762f-7bdc-46fb-9817-9a943670bcba service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:57.015029 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2fe777df-d543-46eb-be48-5f563518601d req-9066762f-7bdc-46fb-9817-9a943670bcba service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:57.015454 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2fe777df-d543-46eb-be48-5f563518601d req-9066762f-7bdc-46fb-9817-9a943670bcba service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:57.026492 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-2fe777df-d543-46eb-be48-5f563518601d req-9066762f-7bdc-46fb-9817-9a943670bcba service nova] Creating event network-changed:faa670fa-8772-41df-9969-225d0abc3e7f for instance 2c19eb73-18d8-490f-94c9-c77d13a60777 on hv-cinder-85083 Aug 29 19:16:57.031742 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-2fe777df-d543-46eb-be48-5f563518601d req-9066762f-7bdc-46fb-9817-9a943670bcba service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030349 Aug 29 19:16:57.032530 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 570/1134] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:17:44.670215 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7d897c38-fd5a-4aae-9ea9-681ee7cf46d5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:44.670821 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7d897c38-fd5a-4aae-9ea9-681ee7cf46d5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:44.672880 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=4 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:44.673555 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=7 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:44.681796 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d897c38-fd5a-4aae-9ea9-681ee7cf46d5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:44.682323 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d897c38-fd5a-4aae-9ea9-681ee7cf46d5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:44.682725 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d897c38-fd5a-4aae-9ea9-681ee7cf46d5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:44.683469 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d897c38-fd5a-4aae-9ea9-681ee7cf46d5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:44.683929 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d897c38-fd5a-4aae-9ea9-681ee7cf46d5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:44.684356 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7d897c38-fd5a-4aae-9ea9-681ee7cf46d5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:44.708171 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7d897c38-fd5a-4aae-9ea9-681ee7cf46d5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85/ips" status: 200 len: 148 microversion: 2.1 time: 0.041885 Aug 29 19:17:44.708862 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 565/1135] 10.222.0.86 () {58 vars in 1248 bytes} [Mon Aug 29 19:17:44 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:17:44.721269 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-388b082c-c1bb-4f2b-8f26-470371f9330a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7ca8ddf-67da-4865-9212-ed69e91c3054"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:17:44.723866 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-388b082c-c1bb-4f2b-8f26-470371f9330a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:44.726838 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=6 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:44.727541 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=12 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:44.733561 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-388b082c-c1bb-4f2b-8f26-470371f9330a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:44.734041 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-388b082c-c1bb-4f2b-8f26-470371f9330a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:44.734472 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-388b082c-c1bb-4f2b-8f26-470371f9330a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:44.735207 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-388b082c-c1bb-4f2b-8f26-470371f9330a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:44.735664 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-388b082c-c1bb-4f2b-8f26-470371f9330a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:44.736085 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-388b082c-c1bb-4f2b-8f26-470371f9330a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:44.815240 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-388b082c-c1bb-4f2b-8f26-470371f9330a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] HTTP exception thrown: Invalid volume: volume f7ca8ddf-67da-4865-9212-ed69e91c3054 is already attached to instances: df8f7dba-a886-4ceb-815a-9c877abfd96d Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-388b082c-c1bb-4f2b-8f26-470371f9330a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Request method failure captured: Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: POST /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85/os-volume_attachments HTTP/1.1 Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 74 Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ_Mg9k-L2RVlFbeDrzZTKh-Rpkrdgjs5wXFw3RL8IjbBzyB1H1GE9m-bwqAzLYHlUBBVR_bizq5cOQPxjvYzlA4ulyNovSWUbczTq-xVO_3xhsRX-kwEtw0YkFnU6IHVIqD7ctMuC14fezNqmeoFr_4Iq_P1nZde-v4GK-exlCenjY Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:17:44.816998 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:17:44.818783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fe9fc68075be4712a305fb8a15c91f19"}]}] Aug 29 19:17:44.818783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:17:44.818783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:17:44.818783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:17:44.818783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:17:44.818783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:17:44.818783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:17:44.818783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: a982dbba4a324a4f893e427000ce9b93 Aug 29 19:17:44.818783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:17:44.818783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Aug 29 19:17:44.818783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {"volumeAttachment": {"volumeId": "f7ca8ddf-67da-4865-9212-ed69e91c3054"}} Aug 29 19:17:44.818783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Invalid volume: volume f7ca8ddf-67da-4865-9212-ed69e91c3054 is already attached to instances: df8f7dba-a886-4ceb-815a-9c877abfd96d Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'server_id': 'a07a4d70-1d0f-41b3-8efe-69013ee7ec85', 'body': {'volumeAttachment': {'volumeId': 'f7ca8ddf-67da-4865-9212-ed69e91c3054'}}} Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f7ca8ddf-67da-4865-9212-ed69e91c3054 is already attached to instances: df8f7dba-a886-4ceb-815a-9c877abfd96d Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:17:44.819988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f7ca8ddf-67da-4865-9212-ed69e91c3054 is already attached to instances: df8f7dba-a886-4ceb-815a-9c877abfd96d Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:17:44.821525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:17:44.823213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:17:44.823213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:17:44.823213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:17:44.823213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f7ca8ddf-67da-4865-9212-ed69e91c3054 is already attached to instances: df8f7dba-a886-4ceb-815a-9c877abfd96d Aug 29 19:17:44.823213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:17:44.823213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-388b082c-c1bb-4f2b-8f26-470371f9330a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Returning 400 to user: Invalid volume: volume f7ca8ddf-67da-4865-9212-ed69e91c3054 is already attached to instances: df8f7dba-a886-4ceb-815a-9c877abfd96d {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:17:44.823213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-388b082c-c1bb-4f2b-8f26-470371f9330a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "POST /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101563 Aug 29 19:17:44.823213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 571/1136] 10.222.0.86 () {60 vars in 1323 bytes} [Mon Aug 29 19:17:44 2022] POST /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:17:44.827517 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ae9a140b-24ac-4223-a588-ecf72d9f9f29 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:44.828002 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ae9a140b-24ac-4223-a588-ecf72d9f9f29 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:44.834546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae9a140b-24ac-4223-a588-ecf72d9f9f29 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:44.835052 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae9a140b-24ac-4223-a588-ecf72d9f9f29 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:44.835467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae9a140b-24ac-4223-a588-ecf72d9f9f29 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:44.836139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae9a140b-24ac-4223-a588-ecf72d9f9f29 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:44.836587 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae9a140b-24ac-4223-a588-ecf72d9f9f29 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:44.837002 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae9a140b-24ac-4223-a588-ecf72d9f9f29 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:44.861576 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ae9a140b-24ac-4223-a588-ecf72d9f9f29 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:17:44.940818 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ae9a140b-24ac-4223-a588-ecf72d9f9f29 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "DELETE /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 204 len: 0 microversion: 2.1 time: 0.116759 Aug 29 19:17:44.941533 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 566/1137] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:17:44 2022] DELETE /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:17:44.949502 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-16be7d47-3bc0-41a2-ba61-638832d98bcb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:44.950118 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-16be7d47-3bc0-41a2-ba61-638832d98bcb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:44.957267 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16be7d47-3bc0-41a2-ba61-638832d98bcb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:44.957757 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16be7d47-3bc0-41a2-ba61-638832d98bcb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:44.958365 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16be7d47-3bc0-41a2-ba61-638832d98bcb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:44.959735 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16be7d47-3bc0-41a2-ba61-638832d98bcb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:44.960201 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16be7d47-3bc0-41a2-ba61-638832d98bcb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:44.960658 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16be7d47-3bc0-41a2-ba61-638832d98bcb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:45.095543 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-16be7d47-3bc0-41a2-ba61-638832d98bcb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:45.104110 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-16be7d47-3bc0-41a2-ba61-638832d98bcb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1679 microversion: 2.1 time: 0.158381 Aug 29 19:17:45.104676 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 572/1138] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:44 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:46.013624 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6924e049-1eaf-4dc5-8d77-a4a98a69d341 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:46.014778 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6924e049-1eaf-4dc5-8d77-a4a98a69d341 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:46.015734 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-5d9b5c89-7c33-42d3-bd80-752951501d1d req-7e195084-a96c-447f-9488-66c503bdc5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9daa10b3-9082-45da-b64d-21be15641cdd", "tag": "2f716230-73f0-46ca-b3c8-2c534d6bab51"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:17:46.021153 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6924e049-1eaf-4dc5-8d77-a4a98a69d341 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:46.021690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6924e049-1eaf-4dc5-8d77-a4a98a69d341 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:46.022128 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6924e049-1eaf-4dc5-8d77-a4a98a69d341 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:46.022837 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6924e049-1eaf-4dc5-8d77-a4a98a69d341 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:46.023431 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6924e049-1eaf-4dc5-8d77-a4a98a69d341 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:46.023860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6924e049-1eaf-4dc5-8d77-a4a98a69d341 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:46.025798 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-5d9b5c89-7c33-42d3-bd80-752951501d1d req-7e195084-a96c-447f-9488-66c503bdc5b1 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:46.026278 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-5d9b5c89-7c33-42d3-bd80-752951501d1d req-7e195084-a96c-447f-9488-66c503bdc5b1 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:46.026759 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-5d9b5c89-7c33-42d3-bd80-752951501d1d req-7e195084-a96c-447f-9488-66c503bdc5b1 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:46.038304 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-5d9b5c89-7c33-42d3-bd80-752951501d1d req-7e195084-a96c-447f-9488-66c503bdc5b1 service nova] Creating event network-changed:2f716230-73f0-46ca-b3c8-2c534d6bab51 for instance 9daa10b3-9082-45da-b64d-21be15641cdd on hv-cinder-85083 Aug 29 19:17:46.043861 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-5d9b5c89-7c33-42d3-bd80-752951501d1d req-7e195084-a96c-447f-9488-66c503bdc5b1 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031879 Aug 29 19:17:46.044705 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 573/1139] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:17:46.051809 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6924e049-1eaf-4dc5-8d77-a4a98a69d341 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:17:46.125940 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7b73f2ac-89ef-4086-ac8f-e2629f7b9ec2 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:46.126640 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7b73f2ac-89ef-4086-ac8f-e2629f7b9ec2 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:46.133016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6924e049-1eaf-4dc5-8d77-a4a98a69d341 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "DELETE /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 204 len: 0 microversion: 2.1 time: 0.124028 Aug 29 19:17:46.136712 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 567/1140] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:17:46 2022] DELETE /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:17:46.136859 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7b73f2ac-89ef-4086-ac8f-e2629f7b9ec2 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:46.136859 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7b73f2ac-89ef-4086-ac8f-e2629f7b9ec2 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:46.136859 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7b73f2ac-89ef-4086-ac8f-e2629f7b9ec2 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:46.136859 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7b73f2ac-89ef-4086-ac8f-e2629f7b9ec2 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:46.137287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7b73f2ac-89ef-4086-ac8f-e2629f7b9ec2 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:46.137287 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7b73f2ac-89ef-4086-ac8f-e2629f7b9ec2 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:46.142107 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-682ca10f-677e-4820-9f10-50a0790dc63e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:46.142827 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-682ca10f-677e-4820-9f10-50a0790dc63e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:46.148862 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-682ca10f-677e-4820-9f10-50a0790dc63e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:46.149355 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-682ca10f-677e-4820-9f10-50a0790dc63e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:46.149794 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-682ca10f-677e-4820-9f10-50a0790dc63e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:46.150509 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-682ca10f-677e-4820-9f10-50a0790dc63e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:46.150967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-682ca10f-677e-4820-9f10-50a0790dc63e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:46.151431 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-682ca10f-677e-4820-9f10-50a0790dc63e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:46.392760 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7b73f2ac-89ef-4086-ac8f-e2629f7b9ec2 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:46.401629 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-682ca10f-677e-4820-9f10-50a0790dc63e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:46.401796 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7b73f2ac-89ef-4086-ac8f-e2629f7b9ec2 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1679 microversion: 2.1 time: 0.279891 Aug 29 19:17:46.402343 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 574/1141] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:46 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1679 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:46.409368 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-682ca10f-677e-4820-9f10-50a0790dc63e tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1578 microversion: 2.1 time: 0.271360 Aug 29 19:17:46.410235 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 568/1142] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:46 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1578 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:47.423980 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fd057aa5-7f4d-4118-8744-81b7c9e2c5b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:47.424581 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fd057aa5-7f4d-4118-8744-81b7c9e2c5b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:47.431086 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd057aa5-7f4d-4118-8744-81b7c9e2c5b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:47.431386 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-88cbe987-b100-463e-b19b-1f5636560807 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:47.431853 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd057aa5-7f4d-4118-8744-81b7c9e2c5b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:47.432084 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-88cbe987-b100-463e-b19b-1f5636560807 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:47.432827 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd057aa5-7f4d-4118-8744-81b7c9e2c5b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:47.433675 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd057aa5-7f4d-4118-8744-81b7c9e2c5b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:47.434198 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd057aa5-7f4d-4118-8744-81b7c9e2c5b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:47.434671 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd057aa5-7f4d-4118-8744-81b7c9e2c5b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:47.438484 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88cbe987-b100-463e-b19b-1f5636560807 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:47.438962 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88cbe987-b100-463e-b19b-1f5636560807 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:47.439422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88cbe987-b100-463e-b19b-1f5636560807 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:47.440111 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88cbe987-b100-463e-b19b-1f5636560807 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:47.440581 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88cbe987-b100-463e-b19b-1f5636560807 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:47.441002 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88cbe987-b100-463e-b19b-1f5636560807 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:47.707768 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-88cbe987-b100-463e-b19b-1f5636560807 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:47.716517 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-88cbe987-b100-463e-b19b-1f5636560807 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1578 microversion: 2.1 time: 0.288963 Aug 29 19:17:47.717093 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 569/1143] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:47 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1578 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:47.718382 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fd057aa5-7f4d-4118-8744-81b7c9e2c5b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:47.726199 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fd057aa5-7f4d-4118-8744-81b7c9e2c5b5 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1679 microversion: 2.1 time: 0.306064 Aug 29 19:17:47.726791 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 575/1144] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:47 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1679 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:48.738290 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-058dc30b-9386-4258-bbe2-8e66deb3ef51 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:48.738880 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-058dc30b-9386-4258-bbe2-8e66deb3ef51 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:48.747037 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3fdd28d4-de67-4ac3-84d3-94ed29da8b71 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:48.747687 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3fdd28d4-de67-4ac3-84d3-94ed29da8b71 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:48.755056 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3fdd28d4-de67-4ac3-84d3-94ed29da8b71 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:48.755521 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3fdd28d4-de67-4ac3-84d3-94ed29da8b71 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:48.756157 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3fdd28d4-de67-4ac3-84d3-94ed29da8b71 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:48.757032 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3fdd28d4-de67-4ac3-84d3-94ed29da8b71 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:48.757829 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3fdd28d4-de67-4ac3-84d3-94ed29da8b71 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:48.758504 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3fdd28d4-de67-4ac3-84d3-94ed29da8b71 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:48.763933 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-058dc30b-9386-4258-bbe2-8e66deb3ef51 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:48.764701 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-058dc30b-9386-4258-bbe2-8e66deb3ef51 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:48.775538 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-058dc30b-9386-4258-bbe2-8e66deb3ef51 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:48.776768 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-058dc30b-9386-4258-bbe2-8e66deb3ef51 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:48.777396 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-058dc30b-9386-4258-bbe2-8e66deb3ef51 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:48.778529 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-058dc30b-9386-4258-bbe2-8e66deb3ef51 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:48.918852 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3fdd28d4-de67-4ac3-84d3-94ed29da8b71 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:48.930677 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3fdd28d4-de67-4ac3-84d3-94ed29da8b71 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1612 microversion: 2.1 time: 0.187428 Aug 29 19:17:48.931611 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 576/1145] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:48 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1612 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:49.098223 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-058dc30b-9386-4258-bbe2-8e66deb3ef51 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:49.110370 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-058dc30b-9386-4258-bbe2-8e66deb3ef51 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1578 microversion: 2.1 time: 0.375891 Aug 29 19:17:49.111674 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 570/1146] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:48 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1578 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:49.144452 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-9126fc2b-79ed-414a-9cac-eec8deb6f6df req-88bfee59-0c54-4050-9201-aadca4011e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a07a4d70-1d0f-41b3-8efe-69013ee7ec85", "name": "network-vif-deleted", "tag": "a2bccc09-69fb-48ef-8907-f73cacf5fbdd"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:17:49.158650 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-9126fc2b-79ed-414a-9cac-eec8deb6f6df req-88bfee59-0c54-4050-9201-aadca4011e49 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:49.159241 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-9126fc2b-79ed-414a-9cac-eec8deb6f6df req-88bfee59-0c54-4050-9201-aadca4011e49 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:49.159823 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-9126fc2b-79ed-414a-9cac-eec8deb6f6df req-88bfee59-0c54-4050-9201-aadca4011e49 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:49.172336 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-9126fc2b-79ed-414a-9cac-eec8deb6f6df req-88bfee59-0c54-4050-9201-aadca4011e49 service nova] Creating event network-vif-deleted:a2bccc09-69fb-48ef-8907-f73cacf5fbdd for instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 on hv-cinder-85083 Aug 29 19:17:49.178503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-9126fc2b-79ed-414a-9cac-eec8deb6f6df req-88bfee59-0c54-4050-9201-aadca4011e49 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037630 Aug 29 19:17:49.179768 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 577/1147] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:17:49.440282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-2d9a271d-9b08-4baf-a6ae-1c1894b3a5e4 req-c1375aae-2842-41e0-87c7-b45521eaa46a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daa10b3-9082-45da-b64d-21be15641cdd", "name": "network-vif-deleted", "tag": "2f716230-73f0-46ca-b3c8-2c534d6bab51"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:17:49.451963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-2d9a271d-9b08-4baf-a6ae-1c1894b3a5e4 req-c1375aae-2842-41e0-87c7-b45521eaa46a service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:49.452682 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-2d9a271d-9b08-4baf-a6ae-1c1894b3a5e4 req-c1375aae-2842-41e0-87c7-b45521eaa46a service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:49.453181 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-2d9a271d-9b08-4baf-a6ae-1c1894b3a5e4 req-c1375aae-2842-41e0-87c7-b45521eaa46a service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:49.465748 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-2d9a271d-9b08-4baf-a6ae-1c1894b3a5e4 req-c1375aae-2842-41e0-87c7-b45521eaa46a service nova] Creating event network-vif-deleted:2f716230-73f0-46ca-b3c8-2c534d6bab51 for instance 9daa10b3-9082-45da-b64d-21be15641cdd on hv-cinder-85083 Aug 29 19:17:49.470817 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-2d9a271d-9b08-4baf-a6ae-1c1894b3a5e4 req-c1375aae-2842-41e0-87c7-b45521eaa46a service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034536 Aug 29 19:17:49.471800 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 571/1148] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:17:49.953455 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-304f29ca-2f14-43d1-a803-1667a95cf81e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:49.954655 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-304f29ca-2f14-43d1-a803-1667a95cf81e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:49.961696 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-304f29ca-2f14-43d1-a803-1667a95cf81e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:49.962167 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-304f29ca-2f14-43d1-a803-1667a95cf81e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:49.962615 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-304f29ca-2f14-43d1-a803-1667a95cf81e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:49.963355 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-304f29ca-2f14-43d1-a803-1667a95cf81e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:49.963805 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-304f29ca-2f14-43d1-a803-1667a95cf81e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:49.964583 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-304f29ca-2f14-43d1-a803-1667a95cf81e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:50.002969 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-304f29ca-2f14-43d1-a803-1667a95cf81e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:50.003577 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-304f29ca-2f14-43d1-a803-1667a95cf81e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:50.004078 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-304f29ca-2f14-43d1-a803-1667a95cf81e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:50.004596 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-304f29ca-2f14-43d1-a803-1667a95cf81e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lazy-loading 'fault' on Instance uuid a07a4d70-1d0f-41b3-8efe-69013ee7ec85 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:17:50.052222 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-304f29ca-2f14-43d1-a803-1667a95cf81e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:50.063797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-304f29ca-2f14-43d1-a803-1667a95cf81e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 200 len: 1331 microversion: 2.1 time: 0.114922 Aug 29 19:17:50.064413 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 578/1149] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:49 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:50.134776 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d6e8be37-5499-4e28-9d97-97cb49a65666 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:50.135606 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d6e8be37-5499-4e28-9d97-97cb49a65666 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:50.142304 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6e8be37-5499-4e28-9d97-97cb49a65666 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:50.142983 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6e8be37-5499-4e28-9d97-97cb49a65666 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:50.143802 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6e8be37-5499-4e28-9d97-97cb49a65666 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:50.144513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6e8be37-5499-4e28-9d97-97cb49a65666 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:50.144967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6e8be37-5499-4e28-9d97-97cb49a65666 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:50.145385 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6e8be37-5499-4e28-9d97-97cb49a65666 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:50.180689 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6e8be37-5499-4e28-9d97-97cb49a65666 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:50.181178 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6e8be37-5499-4e28-9d97-97cb49a65666 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:50.181612 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6e8be37-5499-4e28-9d97-97cb49a65666 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:50.182059 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-d6e8be37-5499-4e28-9d97-97cb49a65666 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lazy-loading 'fault' on Instance uuid 9daa10b3-9082-45da-b64d-21be15641cdd {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:17:50.226492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d6e8be37-5499-4e28-9d97-97cb49a65666 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:50.234631 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d6e8be37-5499-4e28-9d97-97cb49a65666 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 200 len: 1229 microversion: 2.1 time: 0.106579 Aug 29 19:17:50.235478 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 572/1150] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:50 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 1229 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:51.086241 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b14fa10d-44b0-4548-8362-33eee992cf0d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:51.086860 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b14fa10d-44b0-4548-8362-33eee992cf0d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:51.093708 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b14fa10d-44b0-4548-8362-33eee992cf0d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:51.094200 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b14fa10d-44b0-4548-8362-33eee992cf0d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:51.094636 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b14fa10d-44b0-4548-8362-33eee992cf0d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:51.095371 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b14fa10d-44b0-4548-8362-33eee992cf0d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:51.095826 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b14fa10d-44b0-4548-8362-33eee992cf0d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:51.096251 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b14fa10d-44b0-4548-8362-33eee992cf0d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:51.110609 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-b14fa10d-44b0-4548-8362-33eee992cf0d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] HTTP exception thrown: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b14fa10d-44b0-4548-8362-33eee992cf0d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Request method failure captured: Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 HTTP/1.1 Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ_Mg9k-L2RVlFbeDrzZTKh-Rpkrdgjs5wXFw3RL8IjbBzyB1H1GE9m-bwqAzLYHlUBBVR_bizq5cOQPxjvYzlA4ulyNovSWUbczTq-xVO_3xhsRX-kwEtw0YkFnU6IHVIqD7ctMuC14fezNqmeoFr_4Iq_P1nZde-v4GK-exlCenjY Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:17:51.112338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:17:51.114015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fe9fc68075be4712a305fb8a15c91f19"}]}] Aug 29 19:17:51.114015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:17:51.114015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:17:51.114015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:17:51.114015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:17:51.114015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:17:51.114015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:17:51.114015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: a982dbba4a324a4f893e427000ce9b93 Aug 29 19:17:51.114015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:17:51.114015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:17:51.114015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. Aug 29 19:17:51.114015 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': 'a07a4d70-1d0f-41b3-8efe-69013ee7ec85'} Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:17:51.117751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. Aug 29 19:17:51.119309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:17:51.120710 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b14fa10d-44b0-4548-8362-33eee992cf0d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Returning 404 to user: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:17:51.120710 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b14fa10d-44b0-4548-8362-33eee992cf0d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 404 len: 111 microversion: 2.1 time: 0.031985 Aug 29 19:17:51.120710 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 579/1151] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:51 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:17:51.123559 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b98ed854-71f1-45cd-937d-b574cdef6876 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '.version_select at 0x7fb2b9e04af0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:51.143267 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b98ed854-71f1-45cd-937d-b574cdef6876 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994158161" status: 202 len: 0 microversion: 2.1 time: 0.023415 Aug 29 19:17:51.143916 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 573/1152] 10.222.0.86 () {58 vars in 1221 bytes} [Mon Aug 29 19:17:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994158161 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:17:51.257215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-42951d02-f993-4dfc-8dcd-1aeb2fc286ea tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:51.257958 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-42951d02-f993-4dfc-8dcd-1aeb2fc286ea tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 9daa10b3-9082-45da-b64d-21be15641cdd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:51.266031 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42951d02-f993-4dfc-8dcd-1aeb2fc286ea tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:51.266963 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42951d02-f993-4dfc-8dcd-1aeb2fc286ea tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:51.267829 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42951d02-f993-4dfc-8dcd-1aeb2fc286ea tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:51.268738 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42951d02-f993-4dfc-8dcd-1aeb2fc286ea tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:51.269802 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42951d02-f993-4dfc-8dcd-1aeb2fc286ea tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:51.271171 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42951d02-f993-4dfc-8dcd-1aeb2fc286ea tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:51.288973 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-42951d02-f993-4dfc-8dcd-1aeb2fc286ea tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] HTTP exception thrown: Instance 9daa10b3-9082-45da-b64d-21be15641cdd could not be found. Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-42951d02-f993-4dfc-8dcd-1aeb2fc286ea tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Request method failure captured: Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd HTTP/1.1 Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ6xIOHbuCod7G0gYnu-EDseizVg4zjtymjFllgWFW5QRp6-QFAnP-bRSJFl6NwK5qiiQFCorJU9A3OFmZuQOEY9QR_dH_budOBuvkZ10npfNWlzoc1qIPC2ygwRqFs-R9arfgyRyrDR7WL_DpirZZST3ouzsRrzSI3iVHw36crLDcA Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: 5d70fdff5c5a443b9f0ae1a24dfffcd3 Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-TestVolumeBootPattern-456131431 Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:17:51.290520 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:17:51.292308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}] Aug 29 19:17:51.292308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-TestVolumeBootPattern-456131431 Aug 29 19:17:51.292308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 5d70fdff5c5a443b9f0ae1a24dfffcd3 Aug 29 19:17:51.292308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-TestVolumeBootPattern-456131431 Aug 29 19:17:51.292308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-TestVolumeBootPattern-456131431-project Aug 29 19:17:51.292308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:17:51.292308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:17:51.292308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: 0547f15d00f043b99de10f3db7348c62 Aug 29 19:17:51.292308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-TestVolumeBootPattern-456131431-project Aug 29 19:17:51.292308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:17:51.292308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance 9daa10b3-9082-45da-b64d-21be15641cdd could not be found. Aug 29 19:17:51.292308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': '9daa10b3-9082-45da-b64d-21be15641cdd'} Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9daa10b3-9082-45da-b64d-21be15641cdd could not be found. Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:17:51.293261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9daa10b3-9082-45da-b64d-21be15641cdd could not be found. Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9daa10b3-9082-45da-b64d-21be15641cdd could not be found. Aug 29 19:17:51.294779 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:17:51.297327 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-42951d02-f993-4dfc-8dcd-1aeb2fc286ea tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Returning 404 to user: Instance 9daa10b3-9082-45da-b64d-21be15641cdd could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:17:51.297327 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-42951d02-f993-4dfc-8dcd-1aeb2fc286ea tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd" status: 404 len: 111 microversion: 2.1 time: 0.039793 Aug 29 19:17:51.297327 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 580/1153] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:51 2022] GET /compute/v2.1/servers/9daa10b3-9082-45da-b64d-21be15641cdd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:17:51.852840 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-52047783-ae4b-4606-a7e7-b2b0c0816043 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:51.853332 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-52047783-ae4b-4606-a7e7-b2b0c0816043 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:51.859275 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-52047783-ae4b-4606-a7e7-b2b0c0816043 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:51.859755 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-52047783-ae4b-4606-a7e7-b2b0c0816043 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:51.860207 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-52047783-ae4b-4606-a7e7-b2b0c0816043 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:51.860887 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-52047783-ae4b-4606-a7e7-b2b0c0816043 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:51.861332 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-52047783-ae4b-4606-a7e7-b2b0c0816043 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:51.861750 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-52047783-ae4b-4606-a7e7-b2b0c0816043 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:51.941498 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-52047783-ae4b-4606-a7e7-b2b0c0816043 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lazy-loading 'services' on Instance uuid df8f7dba-a886-4ceb-815a-9c877abfd96d {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:17:52.015546 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-52047783-ae4b-4606-a7e7-b2b0c0816043 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "DELETE /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d/os-volume_attachments/f7ca8ddf-67da-4865-9212-ed69e91c3054" status: 202 len: 0 microversion: 2.1 time: 0.166841 Aug 29 19:17:52.016223 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 574/1154] 10.222.0.86 () {58 vars in 1416 bytes} [Mon Aug 29 19:17:51 2022] DELETE /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d/os-volume_attachments/f7ca8ddf-67da-4865-9212-ed69e91c3054 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:17:52.024585 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f8e7c464-1da2-490d-aaac-7e08fd7c035e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:52.026842 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f8e7c464-1da2-490d-aaac-7e08fd7c035e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:52.034459 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f8e7c464-1da2-490d-aaac-7e08fd7c035e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:52.035197 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f8e7c464-1da2-490d-aaac-7e08fd7c035e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:52.035715 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f8e7c464-1da2-490d-aaac-7e08fd7c035e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:52.036505 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f8e7c464-1da2-490d-aaac-7e08fd7c035e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:52.037534 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f8e7c464-1da2-490d-aaac-7e08fd7c035e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:52.038033 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f8e7c464-1da2-490d-aaac-7e08fd7c035e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:52.073770 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f8e7c464-1da2-490d-aaac-7e08fd7c035e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052946 Aug 29 19:17:52.074687 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 581/1155] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:17:52 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:17:53.090428 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-06d51e55-c111-4893-bad8-092c4188c225 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:53.093122 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-06d51e55-c111-4893-bad8-092c4188c225 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:53.099455 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06d51e55-c111-4893-bad8-092c4188c225 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:53.099943 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06d51e55-c111-4893-bad8-092c4188c225 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:53.100379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06d51e55-c111-4893-bad8-092c4188c225 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:53.101156 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06d51e55-c111-4893-bad8-092c4188c225 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:53.101538 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06d51e55-c111-4893-bad8-092c4188c225 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:53.101961 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06d51e55-c111-4893-bad8-092c4188c225 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:53.133689 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-06d51e55-c111-4893-bad8-092c4188c225 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048435 Aug 29 19:17:53.134248 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 575/1156] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:17:53 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:17:54.145948 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-675931a6-34a7-472b-81b0-fc8ba031145c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:54.148820 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-675931a6-34a7-472b-81b0-fc8ba031145c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:54.155267 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-675931a6-34a7-472b-81b0-fc8ba031145c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:54.155763 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-675931a6-34a7-472b-81b0-fc8ba031145c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:54.156188 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-675931a6-34a7-472b-81b0-fc8ba031145c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:54.156878 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-675931a6-34a7-472b-81b0-fc8ba031145c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:54.157322 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-675931a6-34a7-472b-81b0-fc8ba031145c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:54.157743 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-675931a6-34a7-472b-81b0-fc8ba031145c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:54.187456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-675931a6-34a7-472b-81b0-fc8ba031145c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045427 Aug 29 19:17:54.188045 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 582/1157] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:17:54 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:17:54.251115 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ccb66350-fc96-4bea-b714-8f865c9fdead tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:54.251702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ccb66350-fc96-4bea-b714-8f865c9fdead tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:54.258669 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccb66350-fc96-4bea-b714-8f865c9fdead tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:54.259178 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccb66350-fc96-4bea-b714-8f865c9fdead tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:54.259611 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccb66350-fc96-4bea-b714-8f865c9fdead tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:54.260306 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccb66350-fc96-4bea-b714-8f865c9fdead tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:54.260754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccb66350-fc96-4bea-b714-8f865c9fdead tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:54.261168 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccb66350-fc96-4bea-b714-8f865c9fdead tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:54.289082 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ccb66350-fc96-4bea-b714-8f865c9fdead tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:17:54.374464 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ccb66350-fc96-4bea-b714-8f865c9fdead tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "DELETE /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 204 len: 0 microversion: 2.1 time: 0.126844 Aug 29 19:17:54.375444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 576/1158] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:17:54 2022] DELETE /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:17:54.384165 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0e0169ec-4beb-4d94-8d16-c238c1ad7b6c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:54.384783 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0e0169ec-4beb-4d94-8d16-c238c1ad7b6c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:54.391399 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e0169ec-4beb-4d94-8d16-c238c1ad7b6c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:54.391910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e0169ec-4beb-4d94-8d16-c238c1ad7b6c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:54.392355 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e0169ec-4beb-4d94-8d16-c238c1ad7b6c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:54.393257 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e0169ec-4beb-4d94-8d16-c238c1ad7b6c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:54.393711 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e0169ec-4beb-4d94-8d16-c238c1ad7b6c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:54.394133 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e0169ec-4beb-4d94-8d16-c238c1ad7b6c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:54.667863 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0e0169ec-4beb-4d94-8d16-c238c1ad7b6c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:54.675578 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0e0169ec-4beb-4d94-8d16-c238c1ad7b6c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 200 len: 1680 microversion: 2.1 time: 0.295854 Aug 29 19:17:54.676338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 583/1159] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:54 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 1680 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:54.760948 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6d14cea0-1b11-4969-9df9-ee37d73d97b0 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:54.761544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6d14cea0-1b11-4969-9df9-ee37d73d97b0 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:54.767593 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-e76328d7-476b-4de0-950b-f93186f0922b req-0d713412-f22a-49de-8af1-6f507ea7bf51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b03fc5b-3bcc-4a6a-af76-aec661abea8c", "tag": "59b795aa-8009-4683-ad8c-ae35ee12bb84"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:17:54.767804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6d14cea0-1b11-4969-9df9-ee37d73d97b0 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:54.768511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6d14cea0-1b11-4969-9df9-ee37d73d97b0 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:54.769103 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6d14cea0-1b11-4969-9df9-ee37d73d97b0 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:54.769965 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6d14cea0-1b11-4969-9df9-ee37d73d97b0 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:54.770707 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6d14cea0-1b11-4969-9df9-ee37d73d97b0 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:54.771165 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6d14cea0-1b11-4969-9df9-ee37d73d97b0 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:54.778013 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-e76328d7-476b-4de0-950b-f93186f0922b req-0d713412-f22a-49de-8af1-6f507ea7bf51 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:54.778570 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-e76328d7-476b-4de0-950b-f93186f0922b req-0d713412-f22a-49de-8af1-6f507ea7bf51 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:54.779021 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-e76328d7-476b-4de0-950b-f93186f0922b req-0d713412-f22a-49de-8af1-6f507ea7bf51 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:54.790745 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-e76328d7-476b-4de0-950b-f93186f0922b req-0d713412-f22a-49de-8af1-6f507ea7bf51 service nova] Creating event network-changed:59b795aa-8009-4683-ad8c-ae35ee12bb84 for instance 1b03fc5b-3bcc-4a6a-af76-aec661abea8c on hv-cinder-85083 Aug 29 19:17:54.793886 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:54.796463 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-e76328d7-476b-4de0-950b-f93186f0922b req-0d713412-f22a-49de-8af1-6f507ea7bf51 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032749 Aug 29 19:17:54.797674 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 584/1160] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:17:54.798344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6d14cea0-1b11-4969-9df9-ee37d73d97b0 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:17:54.881504 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6d14cea0-1b11-4969-9df9-ee37d73d97b0 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "DELETE /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 204 len: 0 microversion: 2.1 time: 0.124278 Aug 29 19:17:54.882015 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 577/1161] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:17:54 2022] DELETE /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:17:54.891208 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-12204956-8fe0-46cb-bcec-d75959e13273 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:54.892899 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-12204956-8fe0-46cb-bcec-d75959e13273 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:54.899753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-12204956-8fe0-46cb-bcec-d75959e13273 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:54.900273 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-12204956-8fe0-46cb-bcec-d75959e13273 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:54.900831 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-12204956-8fe0-46cb-bcec-d75959e13273 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:54.901547 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-12204956-8fe0-46cb-bcec-d75959e13273 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:54.902009 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-12204956-8fe0-46cb-bcec-d75959e13273 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:54.902467 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-12204956-8fe0-46cb-bcec-d75959e13273 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:55.040369 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-12204956-8fe0-46cb-bcec-d75959e13273 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:55.048336 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-12204956-8fe0-46cb-bcec-d75959e13273 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1578 microversion: 2.1 time: 0.161682 Aug 29 19:17:55.048982 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 585/1162] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:54 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:55.698945 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-33ac7579-0deb-479c-a709-66ef110f9d27 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:55.699734 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-33ac7579-0deb-479c-a709-66ef110f9d27 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:55.706471 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33ac7579-0deb-479c-a709-66ef110f9d27 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:55.706948 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33ac7579-0deb-479c-a709-66ef110f9d27 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:55.707413 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33ac7579-0deb-479c-a709-66ef110f9d27 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:55.708301 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33ac7579-0deb-479c-a709-66ef110f9d27 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:55.708623 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33ac7579-0deb-479c-a709-66ef110f9d27 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:55.709891 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33ac7579-0deb-479c-a709-66ef110f9d27 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:55.855982 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-33ac7579-0deb-479c-a709-66ef110f9d27 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:55.863752 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-33ac7579-0deb-479c-a709-66ef110f9d27 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 200 len: 1680 microversion: 2.1 time: 0.169280 Aug 29 19:17:55.864296 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 578/1163] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:55 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:56.072411 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-86d0759c-c005-43c4-9f3b-b350e421a428 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:56.072930 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-86d0759c-c005-43c4-9f3b-b350e421a428 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:56.079650 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86d0759c-c005-43c4-9f3b-b350e421a428 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:56.080156 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86d0759c-c005-43c4-9f3b-b350e421a428 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:56.080576 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86d0759c-c005-43c4-9f3b-b350e421a428 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:56.081265 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86d0759c-c005-43c4-9f3b-b350e421a428 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:56.081716 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86d0759c-c005-43c4-9f3b-b350e421a428 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:56.082156 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86d0759c-c005-43c4-9f3b-b350e421a428 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:56.246795 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-86d0759c-c005-43c4-9f3b-b350e421a428 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:56.254461 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-86d0759c-c005-43c4-9f3b-b350e421a428 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1578 microversion: 2.1 time: 0.186859 Aug 29 19:17:56.255037 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 586/1164] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:56 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:56.884660 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e92047b0-c1a5-4b06-9293-0f2b66b701fa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:56.885867 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e92047b0-c1a5-4b06-9293-0f2b66b701fa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:56.893923 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e92047b0-c1a5-4b06-9293-0f2b66b701fa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:56.894491 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e92047b0-c1a5-4b06-9293-0f2b66b701fa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:56.895048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e92047b0-c1a5-4b06-9293-0f2b66b701fa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:56.895954 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e92047b0-c1a5-4b06-9293-0f2b66b701fa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:56.896924 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e92047b0-c1a5-4b06-9293-0f2b66b701fa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:56.897349 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e92047b0-c1a5-4b06-9293-0f2b66b701fa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:57.218004 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e92047b0-c1a5-4b06-9293-0f2b66b701fa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:57.228830 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e92047b0-c1a5-4b06-9293-0f2b66b701fa tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 200 len: 1680 microversion: 2.1 time: 0.347870 Aug 29 19:17:57.230157 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 579/1165] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:56 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 1680 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:57.277924 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1e953248-b16f-486d-b65f-cf0907f9c151 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:57.278535 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1e953248-b16f-486d-b65f-cf0907f9c151 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:57.286745 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1e953248-b16f-486d-b65f-cf0907f9c151 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:57.287263 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1e953248-b16f-486d-b65f-cf0907f9c151 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:57.287762 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1e953248-b16f-486d-b65f-cf0907f9c151 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:57.288525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1e953248-b16f-486d-b65f-cf0907f9c151 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:57.288980 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1e953248-b16f-486d-b65f-cf0907f9c151 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:57.289400 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1e953248-b16f-486d-b65f-cf0907f9c151 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:57.573020 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1e953248-b16f-486d-b65f-cf0907f9c151 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:57.581006 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1e953248-b16f-486d-b65f-cf0907f9c151 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1578 microversion: 2.1 time: 0.307165 Aug 29 19:17:57.581983 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 587/1166] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:57 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1578 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:57.684197 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-7479f9f2-869f-4548-baad-1b7d88e83508 req-fdeda77e-5c73-4fe3-ae7e-a614ca8677a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8f7dba-a886-4ceb-815a-9c877abfd96d", "name": "network-vif-deleted", "tag": "942d1592-aedb-4c4c-b557-2e53b2a12a6b"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:17:57.695610 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-7479f9f2-869f-4548-baad-1b7d88e83508 req-fdeda77e-5c73-4fe3-ae7e-a614ca8677a7 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:57.696359 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-7479f9f2-869f-4548-baad-1b7d88e83508 req-fdeda77e-5c73-4fe3-ae7e-a614ca8677a7 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:57.697029 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-7479f9f2-869f-4548-baad-1b7d88e83508 req-fdeda77e-5c73-4fe3-ae7e-a614ca8677a7 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:57.711543 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-7479f9f2-869f-4548-baad-1b7d88e83508 req-fdeda77e-5c73-4fe3-ae7e-a614ca8677a7 service nova] Creating event network-vif-deleted:942d1592-aedb-4c4c-b557-2e53b2a12a6b for instance df8f7dba-a886-4ceb-815a-9c877abfd96d on hv-cinder-85083 Aug 29 19:17:57.717448 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-7479f9f2-869f-4548-baad-1b7d88e83508 req-fdeda77e-5c73-4fe3-ae7e-a614ca8677a7 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036686 Aug 29 19:17:57.719551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 580/1167] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:17:57.789967 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-405feea4-e506-4682-86cf-c2cca5a9067d req-b956495a-1563-418a-8943-09d1f67ebdf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b03fc5b-3bcc-4a6a-af76-aec661abea8c", "name": "network-vif-deleted", "tag": "59b795aa-8009-4683-ad8c-ae35ee12bb84"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:17:57.802934 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-405feea4-e506-4682-86cf-c2cca5a9067d req-b956495a-1563-418a-8943-09d1f67ebdf5 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:57.803807 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-405feea4-e506-4682-86cf-c2cca5a9067d req-b956495a-1563-418a-8943-09d1f67ebdf5 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:57.804624 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-405feea4-e506-4682-86cf-c2cca5a9067d req-b956495a-1563-418a-8943-09d1f67ebdf5 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:57.819182 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-405feea4-e506-4682-86cf-c2cca5a9067d req-b956495a-1563-418a-8943-09d1f67ebdf5 service nova] Creating event network-vif-deleted:59b795aa-8009-4683-ad8c-ae35ee12bb84 for instance 1b03fc5b-3bcc-4a6a-af76-aec661abea8c on hv-cinder-85083 Aug 29 19:17:57.826759 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-405feea4-e506-4682-86cf-c2cca5a9067d req-b956495a-1563-418a-8943-09d1f67ebdf5 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040282 Aug 29 19:17:57.827706 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 588/1168] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:17:58.256913 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-80fbe279-2e7e-4f1a-b5fd-9673b73d9001 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:58.257725 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-80fbe279-2e7e-4f1a-b5fd-9673b73d9001 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:58.263854 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80fbe279-2e7e-4f1a-b5fd-9673b73d9001 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:58.264331 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80fbe279-2e7e-4f1a-b5fd-9673b73d9001 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:58.264758 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80fbe279-2e7e-4f1a-b5fd-9673b73d9001 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:58.265437 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80fbe279-2e7e-4f1a-b5fd-9673b73d9001 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:58.265909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80fbe279-2e7e-4f1a-b5fd-9673b73d9001 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:58.266290 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80fbe279-2e7e-4f1a-b5fd-9673b73d9001 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:58.299509 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80fbe279-2e7e-4f1a-b5fd-9673b73d9001 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:58.300147 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80fbe279-2e7e-4f1a-b5fd-9673b73d9001 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:58.300841 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80fbe279-2e7e-4f1a-b5fd-9673b73d9001 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:58.301396 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-80fbe279-2e7e-4f1a-b5fd-9673b73d9001 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lazy-loading 'fault' on Instance uuid df8f7dba-a886-4ceb-815a-9c877abfd96d {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:17:58.354493 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-80fbe279-2e7e-4f1a-b5fd-9673b73d9001 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:58.363304 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-80fbe279-2e7e-4f1a-b5fd-9673b73d9001 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 200 len: 1330 microversion: 2.1 time: 0.110991 Aug 29 19:17:58.363879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 581/1169] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:58 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 1330 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:58.603933 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-efd5b6fc-2e99-47ab-ab30-ab8e610cdba8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:58.604557 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-efd5b6fc-2e99-47ab-ab30-ab8e610cdba8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:58.610910 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efd5b6fc-2e99-47ab-ab30-ab8e610cdba8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:58.611436 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efd5b6fc-2e99-47ab-ab30-ab8e610cdba8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:58.611899 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efd5b6fc-2e99-47ab-ab30-ab8e610cdba8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:58.612603 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efd5b6fc-2e99-47ab-ab30-ab8e610cdba8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:58.613059 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efd5b6fc-2e99-47ab-ab30-ab8e610cdba8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:58.613481 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efd5b6fc-2e99-47ab-ab30-ab8e610cdba8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:58.649605 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efd5b6fc-2e99-47ab-ab30-ab8e610cdba8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:58.650083 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efd5b6fc-2e99-47ab-ab30-ab8e610cdba8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:58.650656 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efd5b6fc-2e99-47ab-ab30-ab8e610cdba8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:58.650944 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-efd5b6fc-2e99-47ab-ab30-ab8e610cdba8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lazy-loading 'fault' on Instance uuid 1b03fc5b-3bcc-4a6a-af76-aec661abea8c {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:17:58.694953 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-efd5b6fc-2e99-47ab-ab30-ab8e610cdba8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0547f15d00f043b99de10f3db7348c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fdff5c5a443b9f0ae1a24dfffcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:58.702708 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-efd5b6fc-2e99-47ab-ab30-ab8e610cdba8 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 200 len: 1230 microversion: 2.1 time: 0.104142 Aug 29 19:17:58.703305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 589/1170] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:58 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:59.385282 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7cf148fc-6600-4575-a6fb-c522b16dd8be tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:59.385894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7cf148fc-6600-4575-a6fb-c522b16dd8be tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:59.392320 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7cf148fc-6600-4575-a6fb-c522b16dd8be tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:59.392801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7cf148fc-6600-4575-a6fb-c522b16dd8be tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:59.393237 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7cf148fc-6600-4575-a6fb-c522b16dd8be tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:59.393923 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7cf148fc-6600-4575-a6fb-c522b16dd8be tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:59.394374 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7cf148fc-6600-4575-a6fb-c522b16dd8be tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:59.394816 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7cf148fc-6600-4575-a6fb-c522b16dd8be tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:59.407897 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-7cf148fc-6600-4575-a6fb-c522b16dd8be tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] HTTP exception thrown: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7cf148fc-6600-4575-a6fb-c522b16dd8be tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Request method failure captured: Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d HTTP/1.1 Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ_Mg9k-L2RVlFbeDrzZTKh-Rpkrdgjs5wXFw3RL8IjbBzyB1H1GE9m-bwqAzLYHlUBBVR_bizq5cOQPxjvYzlA4ulyNovSWUbczTq-xVO_3xhsRX-kwEtw0YkFnU6IHVIqD7ctMuC14fezNqmeoFr_4Iq_P1nZde-v4GK-exlCenjY Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:17:59.409544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:17:59.411224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fe9fc68075be4712a305fb8a15c91f19"}]}] Aug 29 19:17:59.411224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:17:59.411224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:17:59.411224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:17:59.411224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:17:59.411224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:17:59.411224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:17:59.411224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: a982dbba4a324a4f893e427000ce9b93 Aug 29 19:17:59.411224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:17:59.411224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:17:59.411224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. Aug 29 19:17:59.411224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': 'df8f7dba-a886-4ceb-815a-9c877abfd96d'} Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:17:59.412732 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. Aug 29 19:17:59.414271 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:17:59.415668 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7cf148fc-6600-4575-a6fb-c522b16dd8be tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Returning 404 to user: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:17:59.415668 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7cf148fc-6600-4575-a6fb-c522b16dd8be tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 404 len: 111 microversion: 2.1 time: 0.029593 Aug 29 19:17:59.415668 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 582/1171] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:59 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:17:59.420288 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a3402ddf-f9f0-479b-92bc-19588bcabb9e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '.version_select at 0x7fb2b9ec69d0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:59.439488 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a3402ddf-f9f0-479b-92bc-19588bcabb9e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-559755597" status: 202 len: 0 microversion: 2.1 time: 0.022957 Aug 29 19:17:59.440040 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 590/1172] 10.222.0.86 () {58 vars in 1218 bytes} [Mon Aug 29 19:17:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-559755597 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:17:59.724644 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-67ebb0d0-9f27-4864-9c8f-cc6d0c7d245b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:59.725248 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-67ebb0d0-9f27-4864-9c8f-cc6d0c7d245b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: 1b03fc5b-3bcc-4a6a-af76-aec661abea8c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:59.731145 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67ebb0d0-9f27-4864-9c8f-cc6d0c7d245b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:59.731624 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67ebb0d0-9f27-4864-9c8f-cc6d0c7d245b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:59.732048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67ebb0d0-9f27-4864-9c8f-cc6d0c7d245b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:59.732730 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67ebb0d0-9f27-4864-9c8f-cc6d0c7d245b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:59.733175 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67ebb0d0-9f27-4864-9c8f-cc6d0c7d245b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:59.733587 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67ebb0d0-9f27-4864-9c8f-cc6d0c7d245b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:59.747942 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-67ebb0d0-9f27-4864-9c8f-cc6d0c7d245b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] HTTP exception thrown: Instance 1b03fc5b-3bcc-4a6a-af76-aec661abea8c could not be found. Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-67ebb0d0-9f27-4864-9c8f-cc6d0c7d245b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Request method failure captured: Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c HTTP/1.1 Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ6xIOHbuCod7G0gYnu-EDseizVg4zjtymjFllgWFW5QRp6-QFAnP-bRSJFl6NwK5qiiQFCorJU9A3OFmZuQOEY9QR_dH_budOBuvkZ10npfNWlzoc1qIPC2ygwRqFs-R9arfgyRyrDR7WL_DpirZZST3ouzsRrzSI3iVHw36crLDcA Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 5d70fdff5c5a443b9f0ae1a24dfffcd3 Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-TestVolumeBootPattern-456131431 Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:17:59.749453 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:17:59.751158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}] Aug 29 19:17:59.751158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-TestVolumeBootPattern-456131431 Aug 29 19:17:59.751158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 5d70fdff5c5a443b9f0ae1a24dfffcd3 Aug 29 19:17:59.751158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-TestVolumeBootPattern-456131431 Aug 29 19:17:59.751158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-TestVolumeBootPattern-456131431-project Aug 29 19:17:59.751158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:17:59.751158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:17:59.751158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: 0547f15d00f043b99de10f3db7348c62 Aug 29 19:17:59.751158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-TestVolumeBootPattern-456131431-project Aug 29 19:17:59.751158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:17:59.751158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance 1b03fc5b-3bcc-4a6a-af76-aec661abea8c could not be found. Aug 29 19:17:59.751158 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': '1b03fc5b-3bcc-4a6a-af76-aec661abea8c'} Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b03fc5b-3bcc-4a6a-af76-aec661abea8c could not be found. Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:17:59.755418 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b03fc5b-3bcc-4a6a-af76-aec661abea8c could not be found. Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b03fc5b-3bcc-4a6a-af76-aec661abea8c could not be found. Aug 29 19:17:59.757815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:17:59.759129 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-67ebb0d0-9f27-4864-9c8f-cc6d0c7d245b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Returning 404 to user: Instance 1b03fc5b-3bcc-4a6a-af76-aec661abea8c could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:17:59.759129 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-67ebb0d0-9f27-4864-9c8f-cc6d0c7d245b tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c" status: 404 len: 111 microversion: 2.1 time: 0.030108 Aug 29 19:17:59.759129 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 583/1173] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:59 2022] GET /compute/v2.1/servers/1b03fc5b-3bcc-4a6a-af76-aec661abea8c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:18:00.084501 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8f0cb57c-113c-42e3-95c5-f143cc0e9042 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Action: 'create', calling method: .version_select at 0x7fb2b9d32f70>, body: {"keypair": {"name": "tempest-keypair-2007564638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATlJlUBUs6j1XFAs5PAgZkKXt2CxSRPdApXTJ0eEfhr/Zdy5pgBc9iqQ7dUKWEqTjayhx8kQTliWOMVAYszy8cFeqgeg5JVnBaaO/XGAPbRDqM0MqPgm/ozhR5g67Vc1g=="}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:18:00.101904 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-8f0cb57c-113c-42e3-95c5-f143cc0e9042 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Getting quotas for project fe9fc68075be4712a305fb8a15c91f19. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:18:00.106058 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-8f0cb57c-113c-42e3-95c5-f143cc0e9042 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Getting quotas for user a982dbba4a324a4f893e427000ce9b93 and project fe9fc68075be4712a305fb8a15c91f19. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:18:00.130904 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8f0cb57c-113c-42e3-95c5-f143cc0e9042 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050766 Aug 29 19:18:00.131544 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 591/1174] 10.222.0.86 () {60 vars in 1159 bytes} [Mon Aug 29 19:18:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:18:00.244569 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1e75cbbe-b094-41ff-8153-5b2ae4a60268 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:00.245162 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1e75cbbe-b094-41ff-8153-5b2ae4a60268 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:00.251223 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e75cbbe-b094-41ff-8153-5b2ae4a60268 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:00.251704 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e75cbbe-b094-41ff-8153-5b2ae4a60268 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:00.252134 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e75cbbe-b094-41ff-8153-5b2ae4a60268 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:00.252810 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e75cbbe-b094-41ff-8153-5b2ae4a60268 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:00.253257 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e75cbbe-b094-41ff-8153-5b2ae4a60268 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:00.253673 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e75cbbe-b094-41ff-8153-5b2ae4a60268 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:00.267981 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-1e75cbbe-b094-41ff-8153-5b2ae4a60268 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] HTTP exception thrown: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1e75cbbe-b094-41ff-8153-5b2ae4a60268 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Request method failure captured: Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: DELETE /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 HTTP/1.1 Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ6xIOHbuCod7G0gYnu-EDseizVg4zjtymjFllgWFW5QRp6-QFAnP-bRSJFl6NwK5qiiQFCorJU9A3OFmZuQOEY9QR_dH_budOBuvkZ10npfNWlzoc1qIPC2ygwRqFs-R9arfgyRyrDR7WL_DpirZZST3ouzsRrzSI3iVHw36crLDcA Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 5d70fdff5c5a443b9f0ae1a24dfffcd3 Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-TestVolumeBootPattern-456131431 Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:18:00.269736 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:18:00.271492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}] Aug 29 19:18:00.271492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-TestVolumeBootPattern-456131431 Aug 29 19:18:00.271492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 5d70fdff5c5a443b9f0ae1a24dfffcd3 Aug 29 19:18:00.271492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-TestVolumeBootPattern-456131431 Aug 29 19:18:00.271492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-TestVolumeBootPattern-456131431-project Aug 29 19:18:00.271492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:18:00.271492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:18:00.271492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: 0547f15d00f043b99de10f3db7348c62 Aug 29 19:18:00.271492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-TestVolumeBootPattern-456131431-project Aug 29 19:18:00.271492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:18:00.271492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. Aug 29 19:18:00.271492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': 'ee5a9c09-ea98-4feb-bbe7-f942b9ef1672'} Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:18:00.273022 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. Aug 29 19:18:00.274583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:18:00.276643 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1e75cbbe-b094-41ff-8153-5b2ae4a60268 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Returning 404 to user: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:18:00.276643 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1e75cbbe-b094-41ff-8153-5b2ae4a60268 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "DELETE /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 404 len: 111 microversion: 2.1 time: 0.031728 Aug 29 19:18:00.276643 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 584/1175] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:18:00 2022] DELETE /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:18:00.281845 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a311365b-f5cd-4ac6-a6d1-4909c7d62c3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:00.282747 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a311365b-f5cd-4ac6-a6d1-4909c7d62c3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] [instance: ee5a9c09-ea98-4feb-bbe7-f942b9ef1672] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:00.289867 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a311365b-f5cd-4ac6-a6d1-4909c7d62c3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:00.290440 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a311365b-f5cd-4ac6-a6d1-4909c7d62c3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:00.290955 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a311365b-f5cd-4ac6-a6d1-4909c7d62c3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:00.292426 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a311365b-f5cd-4ac6-a6d1-4909c7d62c3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:00.293180 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a311365b-f5cd-4ac6-a6d1-4909c7d62c3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:00.293620 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a311365b-f5cd-4ac6-a6d1-4909c7d62c3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:00.312260 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-a311365b-f5cd-4ac6-a6d1-4909c7d62c3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] HTTP exception thrown: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a311365b-f5cd-4ac6-a6d1-4909c7d62c3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Request method failure captured: Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 HTTP/1.1 Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ6xIOHbuCod7G0gYnu-EDseizVg4zjtymjFllgWFW5QRp6-QFAnP-bRSJFl6NwK5qiiQFCorJU9A3OFmZuQOEY9QR_dH_budOBuvkZ10npfNWlzoc1qIPC2ygwRqFs-R9arfgyRyrDR7WL_DpirZZST3ouzsRrzSI3iVHw36crLDcA Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: 5d70fdff5c5a443b9f0ae1a24dfffcd3 Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-TestVolumeBootPattern-456131431 Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:18:00.314050 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:18:00.315758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_5d70fdff5c5a443b9f0ae1a24dfffcd3"}]}] Aug 29 19:18:00.315758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-TestVolumeBootPattern-456131431 Aug 29 19:18:00.315758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 5d70fdff5c5a443b9f0ae1a24dfffcd3 Aug 29 19:18:00.315758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-TestVolumeBootPattern-456131431 Aug 29 19:18:00.315758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-TestVolumeBootPattern-456131431-project Aug 29 19:18:00.315758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:18:00.315758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:18:00.315758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: 0547f15d00f043b99de10f3db7348c62 Aug 29 19:18:00.315758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-TestVolumeBootPattern-456131431-project Aug 29 19:18:00.315758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:18:00.315758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. Aug 29 19:18:00.315758 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': 'ee5a9c09-ea98-4feb-bbe7-f942b9ef1672'} Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:18:00.316858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. Aug 29 19:18:00.318515 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:18:00.319677 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a311365b-f5cd-4ac6-a6d1-4909c7d62c3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Returning 404 to user: Instance ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:18:00.319677 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a311365b-f5cd-4ac6-a6d1-4909c7d62c3d tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672" status: 404 len: 111 microversion: 2.1 time: 0.038404 Aug 29 19:18:00.319677 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 592/1176] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:00 2022] GET /compute/v2.1/servers/ee5a9c09-ea98-4feb-bbe7-f942b9ef1672 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:18:01.423804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-349055755", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c198086-2b12-4afa-9f22-a31dfbf52cb2"}], "security_groups": [{"name": "tempest-securitygroup--1474989752"}], "key_name": "tempest-keypair-2007564638", "user_data": "}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:18:01.530609 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] validate_networks() for [('2c198086-2b12-4afa-9f22-a31dfbf52cb2', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:18:01.624433 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-621ab7c4-53c5-48d6-9158-0746167b0241 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] Calling method '.version_select at 0x7fb2b9d75160>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:01.645487 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-621ab7c4-53c5-48d6-9158-0746167b0241 tempest-TestVolumeBootPattern-456131431 tempest-TestVolumeBootPattern-456131431-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-950876423" status: 202 len: 0 microversion: 2.1 time: 0.025004 Aug 29 19:18:01.646214 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 593/1177] 10.222.0.86 () {58 vars in 1260 bytes} [Mon Aug 29 19:18:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-950876423 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:18:01.914890 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:18:01.915417 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:18:01.915896 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:18:01.916336 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:18:01.916838 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:18:01.925677 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:01.926155 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:01.926621 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:01.928019 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:01.928691 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:01.929370 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:01.946501 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Getting quotas for project fe9fc68075be4712a305fb8a15c91f19. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:18:01.950502 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Getting quotas for user a982dbba4a324a4f893e427000ce9b93 and project fe9fc68075be4712a305fb8a15c91f19. Resources: {'cores', 'ram', 'instances'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:18:01.962402 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:18:01.964738 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:18:02.013194 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4289fbef-187d-401c-922a-3205e0a1cbe4 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.593586 Aug 29 19:18:02.014052 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 585/1178] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:18:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:18:02.025112 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-59852037-35a1-4579-845a-8e9acda47e1c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:02.025642 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-59852037-35a1-4579-845a-8e9acda47e1c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:02.081631 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-59852037-35a1-4579-845a-8e9acda47e1c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:02.089314 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-59852037-35a1-4579-845a-8e9acda47e1c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1241 microversion: 2.1 time: 0.068606 Aug 29 19:18:02.090191 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 594/1179] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:02 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:03.110252 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-38ef32a4-2c51-415b-902a-4112cd8b1cef tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:03.110886 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-38ef32a4-2c51-415b-902a-4112cd8b1cef tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:03.173588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-38ef32a4-2c51-415b-902a-4112cd8b1cef tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:03.184179 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-38ef32a4-2c51-415b-902a-4112cd8b1cef tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1241 microversion: 2.1 time: 0.078120 Aug 29 19:18:03.187039 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 586/1180] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:03 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:04.206720 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8695a67c-5490-49f2-a1d5-13badfa72f5f tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:04.207367 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8695a67c-5490-49f2-a1d5-13badfa72f5f tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:04.276454 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8695a67c-5490-49f2-a1d5-13badfa72f5f tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:04.285363 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8695a67c-5490-49f2-a1d5-13badfa72f5f tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1241 microversion: 2.1 time: 0.082503 Aug 29 19:18:04.286022 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 595/1181] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:04 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:05.306374 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a495fb5e-2741-4489-9768-94a823a5202e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:05.307005 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a495fb5e-2741-4489-9768-94a823a5202e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:05.360107 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a495fb5e-2741-4489-9768-94a823a5202e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:05.367032 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a495fb5e-2741-4489-9768-94a823a5202e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1241 microversion: 2.1 time: 0.064552 Aug 29 19:18:05.367796 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 587/1182] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:05 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:06.388052 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6933b569-e5f6-4e36-a173-2820e766706b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:06.388686 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6933b569-e5f6-4e36-a173-2820e766706b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:06.396614 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6933b569-e5f6-4e36-a173-2820e766706b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:06.397102 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6933b569-e5f6-4e36-a173-2820e766706b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:06.397540 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6933b569-e5f6-4e36-a173-2820e766706b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:06.398486 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6933b569-e5f6-4e36-a173-2820e766706b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:06.398951 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6933b569-e5f6-4e36-a173-2820e766706b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:06.399398 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6933b569-e5f6-4e36-a173-2820e766706b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:06.417804 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:06.482592 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6933b569-e5f6-4e36-a173-2820e766706b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:06.490956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6933b569-e5f6-4e36-a173-2820e766706b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1245 microversion: 2.1 time: 0.106805 Aug 29 19:18:06.493045 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 596/1183] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:06 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:07.512853 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1f75ae5e-7512-4a39-97fb-3ea92d2dad49 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:07.514077 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1f75ae5e-7512-4a39-97fb-3ea92d2dad49 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:07.521998 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f75ae5e-7512-4a39-97fb-3ea92d2dad49 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:07.522893 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f75ae5e-7512-4a39-97fb-3ea92d2dad49 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:07.523713 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f75ae5e-7512-4a39-97fb-3ea92d2dad49 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:07.524796 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f75ae5e-7512-4a39-97fb-3ea92d2dad49 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:07.525374 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f75ae5e-7512-4a39-97fb-3ea92d2dad49 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:07.526055 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f75ae5e-7512-4a39-97fb-3ea92d2dad49 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:07.661338 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1f75ae5e-7512-4a39-97fb-3ea92d2dad49 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:07.674575 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1f75ae5e-7512-4a39-97fb-3ea92d2dad49 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1301 microversion: 2.1 time: 0.165775 Aug 29 19:18:07.676059 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 588/1184] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:07 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1301 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:08.495701 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-805e71bd-0cab-4625-a0b2-cd0639e495e9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:08.496240 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-a347ebc5-f6ed-4ffc-952e-7b4d482dbaef req-596ffa16-f85b-4fe8-af32-7ebb039f4009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd46fd90-e3ac-4556-927a-14ce6c51239e", "tag": "7b17bd15-64ac-45c7-b33b-22f23076cf55"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:18:08.498001 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-805e71bd-0cab-4625-a0b2-cd0639e495e9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:08.526364 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-805e71bd-0cab-4625-a0b2-cd0639e495e9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:08.530137 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-805e71bd-0cab-4625-a0b2-cd0639e495e9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:08.531085 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-805e71bd-0cab-4625-a0b2-cd0639e495e9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:08.532756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:08.534078 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-805e71bd-0cab-4625-a0b2-cd0639e495e9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:08.535656 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-805e71bd-0cab-4625-a0b2-cd0639e495e9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:08.537913 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-a347ebc5-f6ed-4ffc-952e-7b4d482dbaef req-596ffa16-f85b-4fe8-af32-7ebb039f4009 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:08.539077 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-805e71bd-0cab-4625-a0b2-cd0639e495e9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:08.542075 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-a347ebc5-f6ed-4ffc-952e-7b4d482dbaef req-596ffa16-f85b-4fe8-af32-7ebb039f4009 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:08.542773 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-a347ebc5-f6ed-4ffc-952e-7b4d482dbaef req-596ffa16-f85b-4fe8-af32-7ebb039f4009 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:08.575383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-a347ebc5-f6ed-4ffc-952e-7b4d482dbaef req-596ffa16-f85b-4fe8-af32-7ebb039f4009 service nova] Creating event network-changed:7b17bd15-64ac-45c7-b33b-22f23076cf55 for instance dd46fd90-e3ac-4556-927a-14ce6c51239e on hv-cinder-85083 Aug 29 19:18:08.585299 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-a347ebc5-f6ed-4ffc-952e-7b4d482dbaef req-596ffa16-f85b-4fe8-af32-7ebb039f4009 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093398 Aug 29 19:18:08.586721 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 589/1185] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:18:08.604798 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-805e71bd-0cab-4625-a0b2-cd0639e495e9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:18:08.702166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d21f6305-9473-430f-be49-f67d901d1e32 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:08.703228 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d21f6305-9473-430f-be49-f67d901d1e32 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:08.711226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d21f6305-9473-430f-be49-f67d901d1e32 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:08.712070 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d21f6305-9473-430f-be49-f67d901d1e32 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:08.712994 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d21f6305-9473-430f-be49-f67d901d1e32 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:08.714816 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d21f6305-9473-430f-be49-f67d901d1e32 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:08.716283 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d21f6305-9473-430f-be49-f67d901d1e32 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:08.717834 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d21f6305-9473-430f-be49-f67d901d1e32 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:08.786273 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-805e71bd-0cab-4625-a0b2-cd0639e495e9 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "DELETE /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 204 len: 0 microversion: 2.1 time: 0.303815 Aug 29 19:18:08.787918 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 597/1186] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:18:08 2022] DELETE /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:18:08.795943 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0dc47bc5-4b87-49d9-8d8a-87a3aadb68ef tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:08.796948 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0dc47bc5-4b87-49d9-8d8a-87a3aadb68ef tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:08.804530 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0dc47bc5-4b87-49d9-8d8a-87a3aadb68ef tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:08.805363 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0dc47bc5-4b87-49d9-8d8a-87a3aadb68ef tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:08.805988 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0dc47bc5-4b87-49d9-8d8a-87a3aadb68ef tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:08.806873 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0dc47bc5-4b87-49d9-8d8a-87a3aadb68ef tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:08.807503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0dc47bc5-4b87-49d9-8d8a-87a3aadb68ef tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:08.808085 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0dc47bc5-4b87-49d9-8d8a-87a3aadb68ef tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:09.068851 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d21f6305-9473-430f-be49-f67d901d1e32 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:09.084579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d21f6305-9473-430f-be49-f67d901d1e32 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1367 microversion: 2.1 time: 0.391412 Aug 29 19:18:09.097941 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 590/1187] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:08 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1367 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:09.126333 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0dc47bc5-4b87-49d9-8d8a-87a3aadb68ef tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:09.147983 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0dc47bc5-4b87-49d9-8d8a-87a3aadb68ef tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.355942 Aug 29 19:18:09.158278 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 598/1188] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:08 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:10.105945 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9b735627-6f2c-40b7-a5af-6ad852b4fd56 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:10.106588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9b735627-6f2c-40b7-a5af-6ad852b4fd56 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:10.112918 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b735627-6f2c-40b7-a5af-6ad852b4fd56 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:10.113544 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b735627-6f2c-40b7-a5af-6ad852b4fd56 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:10.113969 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b735627-6f2c-40b7-a5af-6ad852b4fd56 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:10.114655 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b735627-6f2c-40b7-a5af-6ad852b4fd56 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:10.115433 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b735627-6f2c-40b7-a5af-6ad852b4fd56 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:10.115856 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b735627-6f2c-40b7-a5af-6ad852b4fd56 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:10.171870 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-17f43893-3253-4ed9-93f3-ebab01794e59 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:10.172479 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-17f43893-3253-4ed9-93f3-ebab01794e59 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:10.179097 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-17f43893-3253-4ed9-93f3-ebab01794e59 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:10.179584 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-17f43893-3253-4ed9-93f3-ebab01794e59 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:10.180021 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-17f43893-3253-4ed9-93f3-ebab01794e59 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:10.180715 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-17f43893-3253-4ed9-93f3-ebab01794e59 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:10.181172 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-17f43893-3253-4ed9-93f3-ebab01794e59 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:10.181596 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-17f43893-3253-4ed9-93f3-ebab01794e59 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:10.444057 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9b735627-6f2c-40b7-a5af-6ad852b4fd56 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:10.452118 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9b735627-6f2c-40b7-a5af-6ad852b4fd56 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1367 microversion: 2.1 time: 0.350227 Aug 29 19:18:10.452690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 591/1189] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:10 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:10.509076 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-17f43893-3253-4ed9-93f3-ebab01794e59 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:10.517291 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-17f43893-3253-4ed9-93f3-ebab01794e59 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1568 microversion: 2.1 time: 0.349183 Aug 29 19:18:10.517869 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 599/1190] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:10 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1568 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:18:10.819137 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-17bee9b2-e2ab-433e-b1d3-e911262fb5ef req-337fc51a-d899-4406-80de-9d6cec03a32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7b368a5-aa99-45d7-a00d-c159874ba2be", "tag": "60874621-e8cc-44fb-833b-c5064ce2a225"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:18:10.830568 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-17bee9b2-e2ab-433e-b1d3-e911262fb5ef req-337fc51a-d899-4406-80de-9d6cec03a32c service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:10.831389 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-17bee9b2-e2ab-433e-b1d3-e911262fb5ef req-337fc51a-d899-4406-80de-9d6cec03a32c service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:10.832035 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-17bee9b2-e2ab-433e-b1d3-e911262fb5ef req-337fc51a-d899-4406-80de-9d6cec03a32c service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:10.845368 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-17bee9b2-e2ab-433e-b1d3-e911262fb5ef req-337fc51a-d899-4406-80de-9d6cec03a32c service nova] Creating event network-changed:60874621-e8cc-44fb-833b-c5064ce2a225 for instance d7b368a5-aa99-45d7-a00d-c159874ba2be on hv-cinder-85083 Aug 29 19:18:10.851083 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-17bee9b2-e2ab-433e-b1d3-e911262fb5ef req-337fc51a-d899-4406-80de-9d6cec03a32c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036469 Aug 29 19:18:10.851804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 592/1191] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:18:11.217768 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f3c80c45-a5f1-45a2-8c85-b61f9abf9779 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:18:11.220311 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f3c80c45-a5f1-45a2-8c85-b61f9abf9779 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:11.227738 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f3c80c45-a5f1-45a2-8c85-b61f9abf9779 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:11.228230 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f3c80c45-a5f1-45a2-8c85-b61f9abf9779 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:11.228665 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f3c80c45-a5f1-45a2-8c85-b61f9abf9779 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:11.229509 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f3c80c45-a5f1-45a2-8c85-b61f9abf9779 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:11.229974 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f3c80c45-a5f1-45a2-8c85-b61f9abf9779 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:11.230406 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f3c80c45-a5f1-45a2-8c85-b61f9abf9779 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:11.299744 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-5362f79f-b748-4a2a-bb6e-cabb03a9f41f req-eb77ea9b-d95f-4a14-b255-a3eb5e2ce4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd46fd90-e3ac-4556-927a-14ce6c51239e", "name": "network-vif-deleted", "tag": "7b17bd15-64ac-45c7-b33b-22f23076cf55"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:18:11.311597 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-5362f79f-b748-4a2a-bb6e-cabb03a9f41f req-eb77ea9b-d95f-4a14-b255-a3eb5e2ce4c9 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:11.312430 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-5362f79f-b748-4a2a-bb6e-cabb03a9f41f req-eb77ea9b-d95f-4a14-b255-a3eb5e2ce4c9 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:11.312950 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-5362f79f-b748-4a2a-bb6e-cabb03a9f41f req-eb77ea9b-d95f-4a14-b255-a3eb5e2ce4c9 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:11.328851 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f3c80c45-a5f1-45a2-8c85-b61f9abf9779 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "POST /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/action" status: 202 len: 0 microversion: 2.1 time: 0.114837 Aug 29 19:18:11.330102 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 600/1192] 10.222.0.86 () {60 vars in 1278 bytes} [Mon Aug 29 19:18:11 2022] POST /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:18:11.330925 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-5362f79f-b748-4a2a-bb6e-cabb03a9f41f req-eb77ea9b-d95f-4a14-b255-a3eb5e2ce4c9 service nova] Creating event network-vif-deleted:7b17bd15-64ac-45c7-b33b-22f23076cf55 for instance dd46fd90-e3ac-4556-927a-14ce6c51239e on hv-cinder-85083 Aug 29 19:18:11.337011 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-5362f79f-b748-4a2a-bb6e-cabb03a9f41f req-eb77ea9b-d95f-4a14-b255-a3eb5e2ce4c9 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042182 Aug 29 19:18:11.337805 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 593/1193] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:18:11.341548 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b7321b2d-31ee-4c75-ae1d-f363feaceb12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:11.342245 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b7321b2d-31ee-4c75-ae1d-f363feaceb12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:11.348424 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7321b2d-31ee-4c75-ae1d-f363feaceb12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:11.348902 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7321b2d-31ee-4c75-ae1d-f363feaceb12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:11.349894 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7321b2d-31ee-4c75-ae1d-f363feaceb12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:11.350577 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7321b2d-31ee-4c75-ae1d-f363feaceb12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:11.351221 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7321b2d-31ee-4c75-ae1d-f363feaceb12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:11.351644 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7321b2d-31ee-4c75-ae1d-f363feaceb12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:11.473348 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6f2cebb8-d83e-46d9-8a0e-b44a427aa47b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:11.474071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6f2cebb8-d83e-46d9-8a0e-b44a427aa47b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:11.480332 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6f2cebb8-d83e-46d9-8a0e-b44a427aa47b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:11.480813 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6f2cebb8-d83e-46d9-8a0e-b44a427aa47b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:11.481276 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6f2cebb8-d83e-46d9-8a0e-b44a427aa47b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:11.481959 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6f2cebb8-d83e-46d9-8a0e-b44a427aa47b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:11.482406 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6f2cebb8-d83e-46d9-8a0e-b44a427aa47b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:11.482820 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6f2cebb8-d83e-46d9-8a0e-b44a427aa47b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:11.496593 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b7321b2d-31ee-4c75-ae1d-f363feaceb12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:11.504735 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b7321b2d-31ee-4c75-ae1d-f363feaceb12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1750 microversion: 2.1 time: 0.168359 Aug 29 19:18:11.505792 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 601/1194] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:11 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:11.537726 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-92ad8359-3c1f-4d75-b5d8-0b511b403806 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:11.538257 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-92ad8359-3c1f-4d75-b5d8-0b511b403806 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:11.544340 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-92ad8359-3c1f-4d75-b5d8-0b511b403806 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:11.544818 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-92ad8359-3c1f-4d75-b5d8-0b511b403806 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:11.545247 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-92ad8359-3c1f-4d75-b5d8-0b511b403806 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:11.545929 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-92ad8359-3c1f-4d75-b5d8-0b511b403806 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:11.546377 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-92ad8359-3c1f-4d75-b5d8-0b511b403806 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:11.546797 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-92ad8359-3c1f-4d75-b5d8-0b511b403806 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:11.628390 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-92ad8359-3c1f-4d75-b5d8-0b511b403806 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:11.638709 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-92ad8359-3c1f-4d75-b5d8-0b511b403806 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1219 microversion: 2.1 time: 0.104832 Aug 29 19:18:11.639437 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 602/1195] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:11 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:18:11.653457 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6f2cebb8-d83e-46d9-8a0e-b44a427aa47b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:11.662200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6f2cebb8-d83e-46d9-8a0e-b44a427aa47b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1367 microversion: 2.1 time: 0.192380 Aug 29 19:18:11.663208 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 594/1196] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:11 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:18:12.525954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-760f46f8-f7e6-4542-b48e-e9e53397ee1d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:12.526600 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-760f46f8-f7e6-4542-b48e-e9e53397ee1d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:12.533095 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-760f46f8-f7e6-4542-b48e-e9e53397ee1d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:12.533583 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-760f46f8-f7e6-4542-b48e-e9e53397ee1d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:12.534022 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-760f46f8-f7e6-4542-b48e-e9e53397ee1d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:12.534714 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-760f46f8-f7e6-4542-b48e-e9e53397ee1d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:12.535211 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-760f46f8-f7e6-4542-b48e-e9e53397ee1d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:12.535635 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-760f46f8-f7e6-4542-b48e-e9e53397ee1d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:12.660185 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0101505a-db3f-437e-9e02-6364ba2cbdaf tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:12.660797 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0101505a-db3f-437e-9e02-6364ba2cbdaf tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:12.662739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:12.668795 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0101505a-db3f-437e-9e02-6364ba2cbdaf tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:12.669275 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0101505a-db3f-437e-9e02-6364ba2cbdaf tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:12.669706 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0101505a-db3f-437e-9e02-6364ba2cbdaf tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:12.670425 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0101505a-db3f-437e-9e02-6364ba2cbdaf tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:12.670875 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0101505a-db3f-437e-9e02-6364ba2cbdaf tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:12.671318 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0101505a-db3f-437e-9e02-6364ba2cbdaf tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:12.681805 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-760f46f8-f7e6-4542-b48e-e9e53397ee1d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:12.690302 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-760f46f8-f7e6-4542-b48e-e9e53397ee1d tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1750 microversion: 2.1 time: 0.168169 Aug 29 19:18:12.690879 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 603/1197] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:12 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:12.696224 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-16308570-143f-4aa1-b956-96f4a4a0efef tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:12.696840 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-16308570-143f-4aa1-b956-96f4a4a0efef tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:12.702638 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16308570-143f-4aa1-b956-96f4a4a0efef tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:12.703173 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16308570-143f-4aa1-b956-96f4a4a0efef tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:12.703612 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16308570-143f-4aa1-b956-96f4a4a0efef tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:12.704642 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16308570-143f-4aa1-b956-96f4a4a0efef tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:12.705103 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16308570-143f-4aa1-b956-96f4a4a0efef tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:12.705528 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16308570-143f-4aa1-b956-96f4a4a0efef tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:12.739510 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0101505a-db3f-437e-9e02-6364ba2cbdaf tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:12.747753 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0101505a-db3f-437e-9e02-6364ba2cbdaf tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1219 microversion: 2.1 time: 0.091359 Aug 29 19:18:12.748325 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 595/1198] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:12 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:18:12.834827 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-16308570-143f-4aa1-b956-96f4a4a0efef tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:12.842584 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-16308570-143f-4aa1-b956-96f4a4a0efef tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1367 microversion: 2.1 time: 0.150738 Aug 29 19:18:12.843185 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 604/1199] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:12 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:13.712233 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-48d6776d-8ba2-4932-b47f-4956c13a8586 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:13.713479 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-48d6776d-8ba2-4932-b47f-4956c13a8586 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:13.720204 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-48d6776d-8ba2-4932-b47f-4956c13a8586 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:13.720960 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-48d6776d-8ba2-4932-b47f-4956c13a8586 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:13.721622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-48d6776d-8ba2-4932-b47f-4956c13a8586 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:13.722881 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-48d6776d-8ba2-4932-b47f-4956c13a8586 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:13.723366 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-48d6776d-8ba2-4932-b47f-4956c13a8586 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:13.723976 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-48d6776d-8ba2-4932-b47f-4956c13a8586 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:13.769109 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-49609d8f-e7a8-46aa-b09b-0e13f9610842 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:13.769724 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-49609d8f-e7a8-46aa-b09b-0e13f9610842 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:13.777008 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49609d8f-e7a8-46aa-b09b-0e13f9610842 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:13.777575 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49609d8f-e7a8-46aa-b09b-0e13f9610842 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:13.778077 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49609d8f-e7a8-46aa-b09b-0e13f9610842 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:13.778846 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49609d8f-e7a8-46aa-b09b-0e13f9610842 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:13.779402 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49609d8f-e7a8-46aa-b09b-0e13f9610842 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:13.779890 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49609d8f-e7a8-46aa-b09b-0e13f9610842 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:13.894559 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-49609d8f-e7a8-46aa-b09b-0e13f9610842 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260ffd33f3c443c09fdb8d27a1de846e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f020293da4a45a541d6ca1397380d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:13.904043 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-49609d8f-e7a8-46aa-b09b-0e13f9610842 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 200 len: 1219 microversion: 2.1 time: 0.138295 Aug 29 19:18:13.905002 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 605/1200] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:13 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:18:13.927644 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e2cbda50-5351-4557-9a39-6323414cc4c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:13.928832 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e2cbda50-5351-4557-9a39-6323414cc4c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:13.935447 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:13.938309 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2cbda50-5351-4557-9a39-6323414cc4c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:13.939097 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2cbda50-5351-4557-9a39-6323414cc4c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:13.939839 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2cbda50-5351-4557-9a39-6323414cc4c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:13.941424 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2cbda50-5351-4557-9a39-6323414cc4c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:13.942266 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2cbda50-5351-4557-9a39-6323414cc4c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:13.943440 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2cbda50-5351-4557-9a39-6323414cc4c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:13.984971 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-48d6776d-8ba2-4932-b47f-4956c13a8586 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:13.996692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-48d6776d-8ba2-4932-b47f-4956c13a8586 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1750 microversion: 2.1 time: 0.288978 Aug 29 19:18:14.001748 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 596/1201] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:13 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1750 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:14.271179 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e2cbda50-5351-4557-9a39-6323414cc4c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:14.282921 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=8 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:14.290762 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e2cbda50-5351-4557-9a39-6323414cc4c0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1367 microversion: 2.1 time: 0.373109 Aug 29 19:18:14.291434 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 606/1202] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:13 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:14.928498 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f336d7ce-400b-4127-b335-d92ca4001108 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:14.929367 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f336d7ce-400b-4127-b335-d92ca4001108 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] [instance: dd46fd90-e3ac-4556-927a-14ce6c51239e] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:14.936169 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f336d7ce-400b-4127-b335-d92ca4001108 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:14.936654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f336d7ce-400b-4127-b335-d92ca4001108 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:14.937088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f336d7ce-400b-4127-b335-d92ca4001108 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:14.937788 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f336d7ce-400b-4127-b335-d92ca4001108 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:14.938238 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f336d7ce-400b-4127-b335-d92ca4001108 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:14.938663 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f336d7ce-400b-4127-b335-d92ca4001108 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:14.951849 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-f336d7ce-400b-4127-b335-d92ca4001108 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] HTTP exception thrown: Instance dd46fd90-e3ac-4556-927a-14ce6c51239e could not be found. Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f336d7ce-400b-4127-b335-d92ca4001108 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Request method failure captured: Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e HTTP/1.1 Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ9gvyH0lDAAV05innHTGYOVd_jGRSAD-r2wYFRfCHr9ZdQYeYMPYvq8SYPRtA57NFfFWVRyh3Xokf4N0m1LvJHB0y0ZBOfPDFRl3vb10dCgYCaTuklcepleMhEnXWmfCBMQP7pasdL7WygWuA0LDMlQD394_0K7MoEpDOv7elo-T0M Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: 3d7f020293da4a45a541d6ca1397380d Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-TestShelveInstance-105804690 Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:18:14.953513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:18:14.955899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/3d7f020293da4a45a541d6ca1397380d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/3d7f020293da4a45a541d6ca1397380d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/3d7f020293da4a45a541d6ca1397380d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_3d7f020293da4a45a541d6ca1397380d"}]}] Aug 29 19:18:14.955899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-TestShelveInstance-105804690 Aug 29 19:18:14.955899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 3d7f020293da4a45a541d6ca1397380d Aug 29 19:18:14.955899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-TestShelveInstance-105804690 Aug 29 19:18:14.955899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-TestShelveInstance-105804690-project Aug 29 19:18:14.955899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:18:14.955899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:18:14.955899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: 260ffd33f3c443c09fdb8d27a1de846e Aug 29 19:18:14.955899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-TestShelveInstance-105804690-project Aug 29 19:18:14.955899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:18:14.955899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance dd46fd90-e3ac-4556-927a-14ce6c51239e could not be found. Aug 29 19:18:14.955899 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': 'dd46fd90-e3ac-4556-927a-14ce6c51239e'} Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd46fd90-e3ac-4556-927a-14ce6c51239e could not be found. Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:18:14.956991 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd46fd90-e3ac-4556-927a-14ce6c51239e could not be found. Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd46fd90-e3ac-4556-927a-14ce6c51239e could not be found. Aug 29 19:18:14.959286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:18:14.960966 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f336d7ce-400b-4127-b335-d92ca4001108 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Returning 404 to user: Instance dd46fd90-e3ac-4556-927a-14ce6c51239e could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:18:14.960966 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f336d7ce-400b-4127-b335-d92ca4001108 tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e" status: 404 len: 111 microversion: 2.1 time: 0.031155 Aug 29 19:18:14.960966 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 597/1203] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:14 2022] GET /compute/v2.1/servers/dd46fd90-e3ac-4556-927a-14ce6c51239e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:18:15.023341 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d03de435-d971-4d9a-8f36-8c017c0c6885 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:15.023984 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d03de435-d971-4d9a-8f36-8c017c0c6885 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:15.030336 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d03de435-d971-4d9a-8f36-8c017c0c6885 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:15.030814 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d03de435-d971-4d9a-8f36-8c017c0c6885 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:15.031301 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d03de435-d971-4d9a-8f36-8c017c0c6885 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:15.032012 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d03de435-d971-4d9a-8f36-8c017c0c6885 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:15.032461 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d03de435-d971-4d9a-8f36-8c017c0c6885 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:15.032876 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d03de435-d971-4d9a-8f36-8c017c0c6885 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:15.118257 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9a81b95c-7ffc-4c3d-9c91-c466a0eb53df tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] Calling method '.version_select at 0x7fb2ba172040>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:15.142153 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9a81b95c-7ffc-4c3d-9c91-c466a0eb53df tempest-TestShelveInstance-105804690 tempest-TestShelveInstance-105804690-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2006349790" status: 202 len: 0 microversion: 2.1 time: 0.026224 Aug 29 19:18:15.143951 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 598/1204] 10.222.0.86 () {58 vars in 1254 bytes} [Mon Aug 29 19:18:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2006349790 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:18:15.194663 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d03de435-d971-4d9a-8f36-8c017c0c6885 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:15.204958 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d03de435-d971-4d9a-8f36-8c017c0c6885 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1755 microversion: 2.1 time: 0.184961 Aug 29 19:18:15.205645 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 607/1205] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:15 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:18:15.313562 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e39ac3f7-4c1d-4d30-9b9a-e5261eb2f246 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:15.314299 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e39ac3f7-4c1d-4d30-9b9a-e5261eb2f246 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:15.323681 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e39ac3f7-4c1d-4d30-9b9a-e5261eb2f246 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:15.324164 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e39ac3f7-4c1d-4d30-9b9a-e5261eb2f246 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:15.324601 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e39ac3f7-4c1d-4d30-9b9a-e5261eb2f246 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:15.325315 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e39ac3f7-4c1d-4d30-9b9a-e5261eb2f246 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:15.325762 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e39ac3f7-4c1d-4d30-9b9a-e5261eb2f246 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:15.326178 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e39ac3f7-4c1d-4d30-9b9a-e5261eb2f246 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:15.364714 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=10 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:15.459972 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e39ac3f7-4c1d-4d30-9b9a-e5261eb2f246 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:15.468758 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e39ac3f7-4c1d-4d30-9b9a-e5261eb2f246 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1367 microversion: 2.1 time: 0.158985 Aug 29 19:18:15.469629 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 599/1206] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:15 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:16.234372 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-83b9ec94-0b42-4ae5-9818-5b9477b17a3a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:16.237808 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-83b9ec94-0b42-4ae5-9818-5b9477b17a3a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:16.270022 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83b9ec94-0b42-4ae5-9818-5b9477b17a3a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:16.271447 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83b9ec94-0b42-4ae5-9818-5b9477b17a3a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:16.274784 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83b9ec94-0b42-4ae5-9818-5b9477b17a3a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:16.275754 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83b9ec94-0b42-4ae5-9818-5b9477b17a3a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:16.277594 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83b9ec94-0b42-4ae5-9818-5b9477b17a3a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:16.278210 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83b9ec94-0b42-4ae5-9818-5b9477b17a3a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:16.400051 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-8c63368b-5613-4a7a-9ff9-109d6a7152d1 req-383b8b2a-b81f-40b6-95d9-ecaceeeb65ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7b368a5-aa99-45d7-a00d-c159874ba2be", "name": "network-vif-plugged", "status": "completed", "tag": "60874621-e8cc-44fb-833b-c5064ce2a225"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:18:16.410798 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8c63368b-5613-4a7a-9ff9-109d6a7152d1 req-383b8b2a-b81f-40b6-95d9-ecaceeeb65ba service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:16.412148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8c63368b-5613-4a7a-9ff9-109d6a7152d1 req-383b8b2a-b81f-40b6-95d9-ecaceeeb65ba service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:16.412903 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8c63368b-5613-4a7a-9ff9-109d6a7152d1 req-383b8b2a-b81f-40b6-95d9-ecaceeeb65ba service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:16.425787 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-8c63368b-5613-4a7a-9ff9-109d6a7152d1 req-383b8b2a-b81f-40b6-95d9-ecaceeeb65ba service nova] Creating event network-vif-plugged:60874621-e8cc-44fb-833b-c5064ce2a225 for instance d7b368a5-aa99-45d7-a00d-c159874ba2be on hv-cinder-85083 Aug 29 19:18:16.446317 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-8c63368b-5613-4a7a-9ff9-109d6a7152d1 req-383b8b2a-b81f-40b6-95d9-ecaceeeb65ba service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204318 Aug 29 19:18:16.448928 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 600/1207] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:18:16.479177 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-83b9ec94-0b42-4ae5-9818-5b9477b17a3a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:16.495719 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-83b9ec94-0b42-4ae5-9818-5b9477b17a3a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1755 microversion: 2.1 time: 0.269136 Aug 29 19:18:16.496679 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 608/1208] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:16 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1755 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:16.638239 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7bc15af8-a97b-48ae-a628-6997d0034494 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:16.639104 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7bc15af8-a97b-48ae-a628-6997d0034494 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:16.645569 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bc15af8-a97b-48ae-a628-6997d0034494 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:16.646756 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bc15af8-a97b-48ae-a628-6997d0034494 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:16.647440 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bc15af8-a97b-48ae-a628-6997d0034494 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:16.648368 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bc15af8-a97b-48ae-a628-6997d0034494 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:16.648890 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bc15af8-a97b-48ae-a628-6997d0034494 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:16.649401 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bc15af8-a97b-48ae-a628-6997d0034494 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:16.863797 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7bc15af8-a97b-48ae-a628-6997d0034494 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:16.869291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:16.878824 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7bc15af8-a97b-48ae-a628-6997d0034494 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1367 microversion: 2.1 time: 0.392804 Aug 29 19:18:16.879814 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 601/1209] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:16 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1367 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:18:17.517454 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9ee6cc88-a8a3-425b-af27-26bd97b1c47a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:17.518146 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9ee6cc88-a8a3-425b-af27-26bd97b1c47a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:17.526448 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ee6cc88-a8a3-425b-af27-26bd97b1c47a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:17.526939 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ee6cc88-a8a3-425b-af27-26bd97b1c47a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:17.528042 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ee6cc88-a8a3-425b-af27-26bd97b1c47a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:17.528763 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ee6cc88-a8a3-425b-af27-26bd97b1c47a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:17.529228 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ee6cc88-a8a3-425b-af27-26bd97b1c47a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:17.529652 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ee6cc88-a8a3-425b-af27-26bd97b1c47a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:17.752023 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9ee6cc88-a8a3-425b-af27-26bd97b1c47a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:17.761825 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9ee6cc88-a8a3-425b-af27-26bd97b1c47a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1755 microversion: 2.1 time: 0.248076 Aug 29 19:18:17.762506 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 609/1210] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:17 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1755 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:17.900685 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3b19ea0e-1852-41c9-b711-78f46b3c3364 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:17.901293 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3b19ea0e-1852-41c9-b711-78f46b3c3364 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:17.908857 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3b19ea0e-1852-41c9-b711-78f46b3c3364 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:17.909334 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3b19ea0e-1852-41c9-b711-78f46b3c3364 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:17.909768 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3b19ea0e-1852-41c9-b711-78f46b3c3364 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:17.910451 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3b19ea0e-1852-41c9-b711-78f46b3c3364 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:17.910893 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3b19ea0e-1852-41c9-b711-78f46b3c3364 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:17.911335 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3b19ea0e-1852-41c9-b711-78f46b3c3364 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:18.052301 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3b19ea0e-1852-41c9-b711-78f46b3c3364 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:18.060886 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3b19ea0e-1852-41c9-b711-78f46b3c3364 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1367 microversion: 2.1 time: 0.164945 Aug 29 19:18:18.061654 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 602/1211] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:17 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:18.784404 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5ca58729-3bf9-4764-8c25-3e5cda37ccc5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:18.785768 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5ca58729-3bf9-4764-8c25-3e5cda37ccc5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:18.793079 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ca58729-3bf9-4764-8c25-3e5cda37ccc5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:18.793581 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ca58729-3bf9-4764-8c25-3e5cda37ccc5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:18.794025 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ca58729-3bf9-4764-8c25-3e5cda37ccc5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:18.794738 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ca58729-3bf9-4764-8c25-3e5cda37ccc5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:18.795261 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ca58729-3bf9-4764-8c25-3e5cda37ccc5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:18.795693 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ca58729-3bf9-4764-8c25-3e5cda37ccc5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:18.815467 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:18.947838 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5ca58729-3bf9-4764-8c25-3e5cda37ccc5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:18.956738 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5ca58729-3bf9-4764-8c25-3e5cda37ccc5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1755 microversion: 2.1 time: 0.176723 Aug 29 19:18:18.957313 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 610/1212] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:18 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:19.083759 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3203f67c-16fd-4305-9f72-ce38fdc47a73 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:19.084479 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3203f67c-16fd-4305-9f72-ce38fdc47a73 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:19.092545 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3203f67c-16fd-4305-9f72-ce38fdc47a73 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:19.093036 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3203f67c-16fd-4305-9f72-ce38fdc47a73 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:19.093469 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3203f67c-16fd-4305-9f72-ce38fdc47a73 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:19.094374 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3203f67c-16fd-4305-9f72-ce38fdc47a73 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:19.094819 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3203f67c-16fd-4305-9f72-ce38fdc47a73 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:19.095261 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3203f67c-16fd-4305-9f72-ce38fdc47a73 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:19.230780 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3203f67c-16fd-4305-9f72-ce38fdc47a73 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:19.238467 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3203f67c-16fd-4305-9f72-ce38fdc47a73 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1556 microversion: 2.1 time: 0.160116 Aug 29 19:18:19.239283 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 603/1213] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:19 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:19.258821 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f591b769-ded0-4baa-b997-c2e0a47053bc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:19.259368 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f591b769-ded0-4baa-b997-c2e0a47053bc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:19.265387 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f591b769-ded0-4baa-b997-c2e0a47053bc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:19.265880 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f591b769-ded0-4baa-b997-c2e0a47053bc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:19.266315 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f591b769-ded0-4baa-b997-c2e0a47053bc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:19.267027 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f591b769-ded0-4baa-b997-c2e0a47053bc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:19.267498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f591b769-ded0-4baa-b997-c2e0a47053bc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:19.267917 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f591b769-ded0-4baa-b997-c2e0a47053bc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:19.344746 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f591b769-ded0-4baa-b997-c2e0a47053bc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089944 Aug 29 19:18:19.345345 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 611/1214] 10.222.0.86 () {58 vars in 1275 bytes} [Mon Aug 29 19:18:19 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:18:19.980996 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-861f1f33-34c7-4cce-a043-dea7c725a07c tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:19.981692 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-861f1f33-34c7-4cce-a043-dea7c725a07c tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:19.990227 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-861f1f33-34c7-4cce-a043-dea7c725a07c tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:19.990757 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-861f1f33-34c7-4cce-a043-dea7c725a07c tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:19.994947 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-861f1f33-34c7-4cce-a043-dea7c725a07c tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:19.995903 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-861f1f33-34c7-4cce-a043-dea7c725a07c tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:19.996387 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-861f1f33-34c7-4cce-a043-dea7c725a07c tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:19.996824 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-861f1f33-34c7-4cce-a043-dea7c725a07c tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:20.257317 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-861f1f33-34c7-4cce-a043-dea7c725a07c tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:20.266072 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-861f1f33-34c7-4cce-a043-dea7c725a07c tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1755 microversion: 2.1 time: 0.291734 Aug 29 19:18:20.266782 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 604/1215] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:19 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1755 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:20.420620 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-a4b92d57-cfc2-4a52-9f41-dae818dd2a3e req-6c71df2a-f857-46a2-857a-8686b9abf427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7b368a5-aa99-45d7-a00d-c159874ba2be", "tag": "60874621-e8cc-44fb-833b-c5064ce2a225"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:18:20.431450 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a4b92d57-cfc2-4a52-9f41-dae818dd2a3e req-6c71df2a-f857-46a2-857a-8686b9abf427 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:20.432163 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a4b92d57-cfc2-4a52-9f41-dae818dd2a3e req-6c71df2a-f857-46a2-857a-8686b9abf427 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:20.432760 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a4b92d57-cfc2-4a52-9f41-dae818dd2a3e req-6c71df2a-f857-46a2-857a-8686b9abf427 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:20.447709 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-a4b92d57-cfc2-4a52-9f41-dae818dd2a3e req-6c71df2a-f857-46a2-857a-8686b9abf427 service nova] Creating event network-changed:60874621-e8cc-44fb-833b-c5064ce2a225 for instance d7b368a5-aa99-45d7-a00d-c159874ba2be on hv-cinder-85083 Aug 29 19:18:20.454306 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-a4b92d57-cfc2-4a52-9f41-dae818dd2a3e req-6c71df2a-f857-46a2-857a-8686b9abf427 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037818 Aug 29 19:18:20.455324 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 612/1216] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:18:21.287465 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4964e660-dcc7-4e78-899f-4da614ab0b12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:21.288403 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4964e660-dcc7-4e78-899f-4da614ab0b12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:21.295838 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4964e660-dcc7-4e78-899f-4da614ab0b12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:21.296426 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4964e660-dcc7-4e78-899f-4da614ab0b12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:21.297072 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4964e660-dcc7-4e78-899f-4da614ab0b12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:21.298097 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4964e660-dcc7-4e78-899f-4da614ab0b12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:21.298632 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4964e660-dcc7-4e78-899f-4da614ab0b12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:21.299200 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4964e660-dcc7-4e78-899f-4da614ab0b12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:21.574688 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4964e660-dcc7-4e78-899f-4da614ab0b12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:21.583800 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4964e660-dcc7-4e78-899f-4da614ab0b12 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1755 microversion: 2.1 time: 0.300189 Aug 29 19:18:21.584949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 605/1217] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:21 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1755 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:22.607418 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3a51e9ec-a78a-4f01-a711-28e7a5189796 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:22.608283 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3a51e9ec-a78a-4f01-a711-28e7a5189796 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:22.614882 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a51e9ec-a78a-4f01-a711-28e7a5189796 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:22.615414 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a51e9ec-a78a-4f01-a711-28e7a5189796 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:22.615849 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a51e9ec-a78a-4f01-a711-28e7a5189796 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:22.616553 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a51e9ec-a78a-4f01-a711-28e7a5189796 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:22.616996 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a51e9ec-a78a-4f01-a711-28e7a5189796 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:22.617411 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a51e9ec-a78a-4f01-a711-28e7a5189796 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:22.891351 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3a51e9ec-a78a-4f01-a711-28e7a5189796 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:22.900352 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3a51e9ec-a78a-4f01-a711-28e7a5189796 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1755 microversion: 2.1 time: 0.297902 Aug 29 19:18:22.900919 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 613/1218] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:22 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1755 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:23.921474 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2b1c8c0d-5e76-4ec0-bc6f-6e88003df750 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:23.922095 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2b1c8c0d-5e76-4ec0-bc6f-6e88003df750 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:23.929408 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b1c8c0d-5e76-4ec0-bc6f-6e88003df750 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:23.929895 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b1c8c0d-5e76-4ec0-bc6f-6e88003df750 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:23.930323 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b1c8c0d-5e76-4ec0-bc6f-6e88003df750 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:23.931053 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b1c8c0d-5e76-4ec0-bc6f-6e88003df750 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:23.931507 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b1c8c0d-5e76-4ec0-bc6f-6e88003df750 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:23.931928 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2b1c8c0d-5e76-4ec0-bc6f-6e88003df750 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:24.091265 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2b1c8c0d-5e76-4ec0-bc6f-6e88003df750 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:24.100627 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2b1c8c0d-5e76-4ec0-bc6f-6e88003df750 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1755 microversion: 2.1 time: 0.183021 Aug 29 19:18:24.111711 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 606/1219] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:23 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:25.123313 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-69a77ccf-3170-4cef-94a8-2386e98933e2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:25.124073 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-69a77ccf-3170-4cef-94a8-2386e98933e2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:25.131216 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69a77ccf-3170-4cef-94a8-2386e98933e2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:25.131694 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69a77ccf-3170-4cef-94a8-2386e98933e2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:25.132126 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69a77ccf-3170-4cef-94a8-2386e98933e2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:25.132804 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69a77ccf-3170-4cef-94a8-2386e98933e2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:25.133251 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69a77ccf-3170-4cef-94a8-2386e98933e2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:25.133668 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69a77ccf-3170-4cef-94a8-2386e98933e2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:25.278303 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-69a77ccf-3170-4cef-94a8-2386e98933e2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:25.286596 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-69a77ccf-3170-4cef-94a8-2386e98933e2 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1755 microversion: 2.1 time: 0.167226 Aug 29 19:18:25.287205 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 614/1220] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:25 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:26.307960 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8852a1f6-2887-4c17-8049-48708875baa9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:26.308637 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8852a1f6-2887-4c17-8049-48708875baa9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:26.315093 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8852a1f6-2887-4c17-8049-48708875baa9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:26.315583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8852a1f6-2887-4c17-8049-48708875baa9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:26.316020 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8852a1f6-2887-4c17-8049-48708875baa9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:26.316708 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8852a1f6-2887-4c17-8049-48708875baa9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:26.317162 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8852a1f6-2887-4c17-8049-48708875baa9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:26.317588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8852a1f6-2887-4c17-8049-48708875baa9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:26.458881 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8852a1f6-2887-4c17-8049-48708875baa9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:26.467148 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8852a1f6-2887-4c17-8049-48708875baa9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1758 microversion: 2.1 time: 0.162986 Aug 29 19:18:26.467714 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 607/1221] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:26 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:19:30.163626 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=16 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:30.164956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=20 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:30.165854 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 19:19:30.166007 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Mon Aug 29 19:19:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/action (ip 10.222.0.86) !!! Aug 29 19:19:30.170762 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7d7c6cfd-c7d4-4420-987a-f0f38c972854 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-931963232"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:19:30.171448 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7d7c6cfd-c7d4-4420-987a-f0f38c972854 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:30.179319 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d7c6cfd-c7d4-4420-987a-f0f38c972854 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:30.180386 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d7c6cfd-c7d4-4420-987a-f0f38c972854 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:30.180832 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d7c6cfd-c7d4-4420-987a-f0f38c972854 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:30.181535 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d7c6cfd-c7d4-4420-987a-f0f38c972854 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:30.181990 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d7c6cfd-c7d4-4420-987a-f0f38c972854 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:30.182411 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d7c6cfd-c7d4-4420-987a-f0f38c972854 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:30.313606 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.network.security_group_api [None req-7d7c6cfd-c7d4-4420-987a-f0f38c972854 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Removing security group cae303dc-2808-4f23-902b-e1ee8d7e2937 from port faa670fa-8772-41df-9969-225d0abc3e7f Aug 29 19:19:30.612108 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7d7c6cfd-c7d4-4420-987a-f0f38c972854 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "POST /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/action" status: 202 len: 0 microversion: 2.1 time: 0.450349 Aug 29 19:19:30.612751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 615/1222] 10.222.0.86 () {60 vars in 1278 bytes} [Mon Aug 29 19:19:30 2022] POST /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:19:30.618303 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:30.619105 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=36 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:30.624490 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-fad35121-e353-443f-b08e-e7d6808b5792 req-604c308a-24cf-45df-a405-6eeaeb9fa0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c19eb73-18d8-490f-94c9-c77d13a60777", "tag": "faa670fa-8772-41df-9969-225d0abc3e7f"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:19:30.639193 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-fad35121-e353-443f-b08e-e7d6808b5792 req-604c308a-24cf-45df-a405-6eeaeb9fa0f3 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:30.639386 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-fad35121-e353-443f-b08e-e7d6808b5792 req-604c308a-24cf-45df-a405-6eeaeb9fa0f3 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:30.639767 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-fad35121-e353-443f-b08e-e7d6808b5792 req-604c308a-24cf-45df-a405-6eeaeb9fa0f3 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:30.657661 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-fad35121-e353-443f-b08e-e7d6808b5792 req-604c308a-24cf-45df-a405-6eeaeb9fa0f3 service nova] Creating event network-changed:faa670fa-8772-41df-9969-225d0abc3e7f for instance 2c19eb73-18d8-490f-94c9-c77d13a60777 on hv-cinder-85083 Aug 29 19:19:30.663435 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-fad35121-e353-443f-b08e-e7d6808b5792 req-604c308a-24cf-45df-a405-6eeaeb9fa0f3 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046801 Aug 29 19:19:30.664967 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 608/1223] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:19:31.951201 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-467cceff-bdc3-4e5b-bb35-a472012db771 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:31.951689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-467cceff-bdc3-4e5b-bb35-a472012db771 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:31.957943 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-467cceff-bdc3-4e5b-bb35-a472012db771 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:31.958521 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-467cceff-bdc3-4e5b-bb35-a472012db771 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:31.958961 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-467cceff-bdc3-4e5b-bb35-a472012db771 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:31.959964 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-467cceff-bdc3-4e5b-bb35-a472012db771 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:31.960508 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-467cceff-bdc3-4e5b-bb35-a472012db771 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:31.961866 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-467cceff-bdc3-4e5b-bb35-a472012db771 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:32.042169 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-467cceff-bdc3-4e5b-bb35-a472012db771 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lazy-loading 'services' on Instance uuid 2c19eb73-18d8-490f-94c9-c77d13a60777 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:19:32.119013 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-467cceff-bdc3-4e5b-bb35-a472012db771 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "DELETE /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/os-volume_attachments/108394ac-5726-4211-9350-19cadeebab0f" status: 202 len: 0 microversion: 2.1 time: 0.172255 Aug 29 19:19:32.119865 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 616/1224] 10.222.0.86 () {58 vars in 1416 bytes} [Mon Aug 29 19:19:31 2022] DELETE /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/os-volume_attachments/108394ac-5726-4211-9350-19cadeebab0f => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:19:32.128829 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-732df1fa-13a1-4868-b412-13e8dcbff0f0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:32.131538 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-732df1fa-13a1-4868-b412-13e8dcbff0f0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:32.138919 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-732df1fa-13a1-4868-b412-13e8dcbff0f0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:32.139497 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-732df1fa-13a1-4868-b412-13e8dcbff0f0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:32.140086 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-732df1fa-13a1-4868-b412-13e8dcbff0f0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:32.140946 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-732df1fa-13a1-4868-b412-13e8dcbff0f0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:32.141484 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-732df1fa-13a1-4868-b412-13e8dcbff0f0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:32.142106 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-732df1fa-13a1-4868-b412-13e8dcbff0f0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:32.173051 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-732df1fa-13a1-4868-b412-13e8dcbff0f0 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048656 Aug 29 19:19:32.173645 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 609/1225] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:19:32 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:19:32.679235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-4f9c5b9c-353d-4bc1-8672-dd748a7a1953 req-7c5156df-496e-45d0-91ee-4210c7d720ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c19eb73-18d8-490f-94c9-c77d13a60777", "tag": "faa670fa-8772-41df-9969-225d0abc3e7f"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:19:32.691396 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-4f9c5b9c-353d-4bc1-8672-dd748a7a1953 req-7c5156df-496e-45d0-91ee-4210c7d720ba service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:32.692090 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-4f9c5b9c-353d-4bc1-8672-dd748a7a1953 req-7c5156df-496e-45d0-91ee-4210c7d720ba service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:32.692305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-4f9c5b9c-353d-4bc1-8672-dd748a7a1953 req-7c5156df-496e-45d0-91ee-4210c7d720ba service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:32.705549 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-4f9c5b9c-353d-4bc1-8672-dd748a7a1953 req-7c5156df-496e-45d0-91ee-4210c7d720ba service nova] Creating event network-changed:faa670fa-8772-41df-9969-225d0abc3e7f for instance 2c19eb73-18d8-490f-94c9-c77d13a60777 on hv-cinder-85083 Aug 29 19:19:32.711371 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-4f9c5b9c-353d-4bc1-8672-dd748a7a1953 req-7c5156df-496e-45d0-91ee-4210c7d720ba service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036357 Aug 29 19:19:32.711966 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 617/1226] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:19:33.186132 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-640ff9ad-628a-4227-9681-3f5156344ad7 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:33.188325 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-640ff9ad-628a-4227-9681-3f5156344ad7 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:33.194701 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-640ff9ad-628a-4227-9681-3f5156344ad7 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:33.195410 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-640ff9ad-628a-4227-9681-3f5156344ad7 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:33.196097 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-640ff9ad-628a-4227-9681-3f5156344ad7 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:33.196800 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-640ff9ad-628a-4227-9681-3f5156344ad7 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:33.197254 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-640ff9ad-628a-4227-9681-3f5156344ad7 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:33.197708 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-640ff9ad-628a-4227-9681-3f5156344ad7 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:33.229380 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-640ff9ad-628a-4227-9681-3f5156344ad7 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047192 Aug 29 19:19:33.229949 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 610/1227] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:19:33 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:19:33.241342 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a0758cbb-384d-46e8-ba5b-3e80f65fd493 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:33.241920 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a0758cbb-384d-46e8-ba5b-3e80f65fd493 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:33.249305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a0758cbb-384d-46e8-ba5b-3e80f65fd493 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:33.249857 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a0758cbb-384d-46e8-ba5b-3e80f65fd493 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:33.250355 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a0758cbb-384d-46e8-ba5b-3e80f65fd493 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:33.251147 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a0758cbb-384d-46e8-ba5b-3e80f65fd493 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:33.251665 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a0758cbb-384d-46e8-ba5b-3e80f65fd493 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:33.252151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a0758cbb-384d-46e8-ba5b-3e80f65fd493 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:33.328741 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-a0758cbb-384d-46e8-ba5b-3e80f65fd493 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] HTTP exception thrown: Instance 2c19eb73-18d8-490f-94c9-c77d13a60777 is not attached to volume 108394ac-5726-4211-9350-19cadeebab0f Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a0758cbb-384d-46e8-ba5b-3e80f65fd493 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Request method failure captured: Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: DELETE /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/os-volume_attachments/108394ac-5726-4211-9350-19cadeebab0f HTTP/1.1 Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDRBsO0OsdbAJw5HNogDU-mJjNTSk6C7eZ_iRpIC8V695PXzJH6GkfwLc5J3iXyCHUxmo3Upcuaa3aVMqoKJ8u6g-Yzh_vuxrsIMFcjBIlz0gaqjDd3C86e6U3fdJSB8FANdv39OpWd9TNDPrSw1opHQOMlXL1bBhFfKvG_rWypxcqHw Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: bd38972fd2dc4dda987f96f0a6aedcc7 Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-TestMinimumBasicScenario-1193080962 Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:19:33.331417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:19:33.333235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/bd38972fd2dc4dda987f96f0a6aedcc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/bd38972fd2dc4dda987f96f0a6aedcc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/bd38972fd2dc4dda987f96f0a6aedcc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_bd38972fd2dc4dda987f96f0a6aedcc7"}]}] Aug 29 19:19:33.333235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-TestMinimumBasicScenario-1193080962 Aug 29 19:19:33.333235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: bd38972fd2dc4dda987f96f0a6aedcc7 Aug 29 19:19:33.333235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1193080962 Aug 29 19:19:33.333235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-TestMinimumBasicScenario-1193080962-project Aug 29 19:19:33.333235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:19:33.333235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:19:33.333235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: a4fe2e98ec3d42ccadd648a53fd7b074 Aug 29 19:19:33.333235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-TestMinimumBasicScenario-1193080962-project Aug 29 19:19:33.333235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:19:33.333235 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance 2c19eb73-18d8-490f-94c9-c77d13a60777 is not attached to volume 108394ac-5726-4211-9350-19cadeebab0f Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'server_id': '2c19eb73-18d8-490f-94c9-c77d13a60777', 'id': '108394ac-5726-4211-9350-19cadeebab0f'} Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 108394ac-5726-4211-9350-19cadeebab0f. Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:19:33.334305 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:19:33.336689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:19:33.336689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 19:19:33.336689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 19:19:33.336689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c19eb73-18d8-490f-94c9-c77d13a60777 is not attached to volume 108394ac-5726-4211-9350-19cadeebab0f Aug 29 19:19:33.336689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:19:33.336689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:19:33.336689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:19:33.336689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:19:33.336689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:19:33.336689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:19:33.336689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:19:33.336689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:19:33.336689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c19eb73-18d8-490f-94c9-c77d13a60777 is not attached to volume 108394ac-5726-4211-9350-19cadeebab0f Aug 29 19:19:33.336689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:19:33.336689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a0758cbb-384d-46e8-ba5b-3e80f65fd493 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Returning 404 to user: Instance 2c19eb73-18d8-490f-94c9-c77d13a60777 is not attached to volume 108394ac-5726-4211-9350-19cadeebab0f {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:19:33.338273 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a0758cbb-384d-46e8-ba5b-3e80f65fd493 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "DELETE /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/os-volume_attachments/108394ac-5726-4211-9350-19cadeebab0f" status: 404 len: 154 microversion: 2.1 time: 0.096223 Aug 29 19:19:33.338273 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 618/1228] 10.222.0.86 () {58 vars in 1416 bytes} [Mon Aug 29 19:19:33 2022] DELETE /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777/os-volume_attachments/108394ac-5726-4211-9350-19cadeebab0f => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:19:34.470030 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d79e684b-a8fb-4fdc-a86d-34922ec5de53 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:34.471050 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d79e684b-a8fb-4fdc-a86d-34922ec5de53 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:34.477754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d79e684b-a8fb-4fdc-a86d-34922ec5de53 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:34.478229 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d79e684b-a8fb-4fdc-a86d-34922ec5de53 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:34.478658 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d79e684b-a8fb-4fdc-a86d-34922ec5de53 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:34.479357 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d79e684b-a8fb-4fdc-a86d-34922ec5de53 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:34.479800 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d79e684b-a8fb-4fdc-a86d-34922ec5de53 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:34.480214 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d79e684b-a8fb-4fdc-a86d-34922ec5de53 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:34.504378 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d79e684b-a8fb-4fdc-a86d-34922ec5de53 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:19:34.580511 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d79e684b-a8fb-4fdc-a86d-34922ec5de53 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "DELETE /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 204 len: 0 microversion: 2.1 time: 0.113778 Aug 29 19:19:34.581245 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 611/1229] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:19:34 2022] DELETE /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:19:34.590887 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5f2c0f17-f236-4641-9453-93aa013a59cb tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:34.591898 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5f2c0f17-f236-4641-9453-93aa013a59cb tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:34.598419 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f2c0f17-f236-4641-9453-93aa013a59cb tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:34.598901 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f2c0f17-f236-4641-9453-93aa013a59cb tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:34.599599 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f2c0f17-f236-4641-9453-93aa013a59cb tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:34.600304 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f2c0f17-f236-4641-9453-93aa013a59cb tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:34.600761 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f2c0f17-f236-4641-9453-93aa013a59cb tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:34.601191 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f2c0f17-f236-4641-9453-93aa013a59cb tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:34.735176 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5f2c0f17-f236-4641-9453-93aa013a59cb tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:19:34.743568 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5f2c0f17-f236-4641-9453-93aa013a59cb tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1553 microversion: 2.1 time: 0.157143 Aug 29 19:19:34.744128 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 619/1230] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:19:34 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:19:35.764866 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-55546f25-1aed-4c99-b048-384223f07ff5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:35.765619 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-55546f25-1aed-4c99-b048-384223f07ff5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:35.772076 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55546f25-1aed-4c99-b048-384223f07ff5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:35.772554 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55546f25-1aed-4c99-b048-384223f07ff5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:35.772989 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55546f25-1aed-4c99-b048-384223f07ff5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:35.773672 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55546f25-1aed-4c99-b048-384223f07ff5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:35.774111 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55546f25-1aed-4c99-b048-384223f07ff5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:35.774527 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-55546f25-1aed-4c99-b048-384223f07ff5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:35.901676 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-55546f25-1aed-4c99-b048-384223f07ff5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:19:35.909365 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-55546f25-1aed-4c99-b048-384223f07ff5 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1553 microversion: 2.1 time: 0.148717 Aug 29 19:19:35.910168 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 612/1231] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:19:35 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:19:36.507163 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6c5d819a-ff06-4cdd-9606-8e515b425ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:36.508285 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6c5d819a-ff06-4cdd-9606-8e515b425ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:36.514702 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c5d819a-ff06-4cdd-9606-8e515b425ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:36.515216 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c5d819a-ff06-4cdd-9606-8e515b425ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:36.515655 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c5d819a-ff06-4cdd-9606-8e515b425ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:36.516338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c5d819a-ff06-4cdd-9606-8e515b425ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:36.516800 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c5d819a-ff06-4cdd-9606-8e515b425ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:36.517206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6c5d819a-ff06-4cdd-9606-8e515b425ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:36.540490 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6c5d819a-ff06-4cdd-9606-8e515b425ca9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/ips" status: 200 len: 149 microversion: 2.1 time: 0.036834 Aug 29 19:19:36.540944 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 620/1232] 10.222.0.86 () {58 vars in 1248 bytes} [Mon Aug 29 19:19:36 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:19:36.930879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-48bc941f-eed3-4d8a-84e0-209363c169d4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:36.931518 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-48bc941f-eed3-4d8a-84e0-209363c169d4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:36.938087 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-48bc941f-eed3-4d8a-84e0-209363c169d4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:36.938570 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-48bc941f-eed3-4d8a-84e0-209363c169d4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:36.938987 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-48bc941f-eed3-4d8a-84e0-209363c169d4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:36.939685 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-48bc941f-eed3-4d8a-84e0-209363c169d4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:36.940127 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-48bc941f-eed3-4d8a-84e0-209363c169d4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:36.940540 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-48bc941f-eed3-4d8a-84e0-209363c169d4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:37.111536 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-48bc941f-eed3-4d8a-84e0-209363c169d4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:19:37.120254 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-48bc941f-eed3-4d8a-84e0-209363c169d4 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1553 microversion: 2.1 time: 0.194222 Aug 29 19:19:37.120820 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 613/1233] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:19:36 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:19:37.536319 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-0ab92e24-f24e-40cb-9ac2-c6936dced49c req-6d3be527-537f-492d-9e80-cda6fa9a2c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c19eb73-18d8-490f-94c9-c77d13a60777", "name": "network-vif-deleted", "tag": "faa670fa-8772-41df-9969-225d0abc3e7f"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:19:37.547867 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-0ab92e24-f24e-40cb-9ac2-c6936dced49c req-6d3be527-537f-492d-9e80-cda6fa9a2c13 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:37.548383 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-0ab92e24-f24e-40cb-9ac2-c6936dced49c req-6d3be527-537f-492d-9e80-cda6fa9a2c13 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:37.548965 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-0ab92e24-f24e-40cb-9ac2-c6936dced49c req-6d3be527-537f-492d-9e80-cda6fa9a2c13 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:37.562901 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-0ab92e24-f24e-40cb-9ac2-c6936dced49c req-6d3be527-537f-492d-9e80-cda6fa9a2c13 service nova] Creating event network-vif-deleted:faa670fa-8772-41df-9969-225d0abc3e7f for instance 2c19eb73-18d8-490f-94c9-c77d13a60777 on hv-cinder-85083 Aug 29 19:19:37.568108 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-0ab92e24-f24e-40cb-9ac2-c6936dced49c req-6d3be527-537f-492d-9e80-cda6fa9a2c13 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035743 Aug 29 19:19:37.568693 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 621/1234] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:19:37.871465 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-73d802dd-037a-44cd-867f-97ca704a7f2b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e45a137-13fc-48f4-a71e-b22589766fb0"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:19:37.873754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-73d802dd-037a-44cd-867f-97ca704a7f2b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:37.879817 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73d802dd-037a-44cd-867f-97ca704a7f2b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:37.880297 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73d802dd-037a-44cd-867f-97ca704a7f2b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:37.880727 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73d802dd-037a-44cd-867f-97ca704a7f2b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:37.881419 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73d802dd-037a-44cd-867f-97ca704a7f2b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:37.881859 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73d802dd-037a-44cd-867f-97ca704a7f2b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:37.882277 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73d802dd-037a-44cd-867f-97ca704a7f2b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:38.142019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2ba13c8d-e9bb-4eec-9778-0847e9d956b9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:38.142704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2ba13c8d-e9bb-4eec-9778-0847e9d956b9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:38.152609 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ba13c8d-e9bb-4eec-9778-0847e9d956b9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:38.153096 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ba13c8d-e9bb-4eec-9778-0847e9d956b9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:38.153523 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ba13c8d-e9bb-4eec-9778-0847e9d956b9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:38.154423 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ba13c8d-e9bb-4eec-9778-0847e9d956b9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:38.154870 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ba13c8d-e9bb-4eec-9778-0847e9d956b9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:38.155317 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ba13c8d-e9bb-4eec-9778-0847e9d956b9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:38.190213 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ba13c8d-e9bb-4eec-9778-0847e9d956b9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:38.190689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ba13c8d-e9bb-4eec-9778-0847e9d956b9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:38.191150 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ba13c8d-e9bb-4eec-9778-0847e9d956b9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:38.191590 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-2ba13c8d-e9bb-4eec-9778-0847e9d956b9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lazy-loading 'fault' on Instance uuid 2c19eb73-18d8-490f-94c9-c77d13a60777 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:19:38.241793 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2ba13c8d-e9bb-4eec-9778-0847e9d956b9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fe2e98ec3d42ccadd648a53fd7b074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd38972fd2dc4dda987f96f0a6aedcc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:19:38.249812 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2ba13c8d-e9bb-4eec-9778-0847e9d956b9 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 200 len: 1348 microversion: 2.1 time: 0.112254 Aug 29 19:19:38.250360 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 622/1235] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:19:38 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 1348 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:19:38.272463 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-73d802dd-037a-44cd-867f-97ca704a7f2b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "POST /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405189 Aug 29 19:19:38.273070 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 614/1236] 10.222.0.86 () {60 vars in 1323 bytes} [Mon Aug 29 19:19:37 2022] POST /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:19:39.272825 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3f078b7a-6e4f-40bb-bc36-a05338f53c57 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:39.273409 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3f078b7a-6e4f-40bb-bc36-a05338f53c57 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] [instance: 2c19eb73-18d8-490f-94c9-c77d13a60777] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:39.279745 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f078b7a-6e4f-40bb-bc36-a05338f53c57 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:39.280217 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f078b7a-6e4f-40bb-bc36-a05338f53c57 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:39.280642 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f078b7a-6e4f-40bb-bc36-a05338f53c57 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:39.281319 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f078b7a-6e4f-40bb-bc36-a05338f53c57 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:39.281762 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f078b7a-6e4f-40bb-bc36-a05338f53c57 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:39.282179 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f078b7a-6e4f-40bb-bc36-a05338f53c57 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:39.295989 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-3f078b7a-6e4f-40bb-bc36-a05338f53c57 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] HTTP exception thrown: Instance 2c19eb73-18d8-490f-94c9-c77d13a60777 could not be found. Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3f078b7a-6e4f-40bb-bc36-a05338f53c57 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Request method failure captured: Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 HTTP/1.1 Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDRBsO0OsdbAJw5HNogDU-mJjNTSk6C7eZ_iRpIC8V695PXzJH6GkfwLc5J3iXyCHUxmo3Upcuaa3aVMqoKJ8u6g-Yzh_vuxrsIMFcjBIlz0gaqjDd3C86e6U3fdJSB8FANdv39OpWd9TNDPrSw1opHQOMlXL1bBhFfKvG_rWypxcqHw Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: bd38972fd2dc4dda987f96f0a6aedcc7 Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-TestMinimumBasicScenario-1193080962 Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:19:39.297956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:19:39.299695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/bd38972fd2dc4dda987f96f0a6aedcc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/bd38972fd2dc4dda987f96f0a6aedcc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/bd38972fd2dc4dda987f96f0a6aedcc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_bd38972fd2dc4dda987f96f0a6aedcc7"}]}] Aug 29 19:19:39.299695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-TestMinimumBasicScenario-1193080962 Aug 29 19:19:39.299695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: bd38972fd2dc4dda987f96f0a6aedcc7 Aug 29 19:19:39.299695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1193080962 Aug 29 19:19:39.299695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-TestMinimumBasicScenario-1193080962-project Aug 29 19:19:39.299695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:19:39.299695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:19:39.299695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: a4fe2e98ec3d42ccadd648a53fd7b074 Aug 29 19:19:39.299695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-TestMinimumBasicScenario-1193080962-project Aug 29 19:19:39.299695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:19:39.299695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance 2c19eb73-18d8-490f-94c9-c77d13a60777 could not be found. Aug 29 19:19:39.299695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': '2c19eb73-18d8-490f-94c9-c77d13a60777'} Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c19eb73-18d8-490f-94c9-c77d13a60777 could not be found. Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:19:39.300753 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c19eb73-18d8-490f-94c9-c77d13a60777 could not be found. Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c19eb73-18d8-490f-94c9-c77d13a60777 could not be found. Aug 29 19:19:39.302232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:19:39.303711 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3f078b7a-6e4f-40bb-bc36-a05338f53c57 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Returning 404 to user: Instance 2c19eb73-18d8-490f-94c9-c77d13a60777 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:19:39.303711 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3f078b7a-6e4f-40bb-bc36-a05338f53c57 tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777" status: 404 len: 111 microversion: 2.1 time: 0.030552 Aug 29 19:19:39.303711 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 623/1237] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:19:39 2022] GET /compute/v2.1/servers/2c19eb73-18d8-490f-94c9-c77d13a60777 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:19:39.310355 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cc872050-e6aa-4ded-969d-a76252ef682a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] Calling method '.version_select at 0x7fb2b9eb3ca0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:39.328541 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-cc872050-e6aa-4ded-969d-a76252ef682a tempest-TestMinimumBasicScenario-1193080962 tempest-TestMinimumBasicScenario-1193080962-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-274731984" status: 202 len: 0 microversion: 2.1 time: 0.022905 Aug 29 19:19:39.329129 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 615/1238] 10.222.0.86 () {58 vars in 1269 bytes} [Mon Aug 29 19:19:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-274731984 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:19:45.888634 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-52e69def-2dfc-4cd8-8da1-7c839074c194 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e45a137-13fc-48f4-a71e-b22589766fb0"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:19:45.891014 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-52e69def-2dfc-4cd8-8da1-7c839074c194 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:45.904822 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-52e69def-2dfc-4cd8-8da1-7c839074c194 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:45.905349 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-52e69def-2dfc-4cd8-8da1-7c839074c194 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:45.905791 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-52e69def-2dfc-4cd8-8da1-7c839074c194 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:45.907479 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-52e69def-2dfc-4cd8-8da1-7c839074c194 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:45.908108 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-52e69def-2dfc-4cd8-8da1-7c839074c194 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:45.908733 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-52e69def-2dfc-4cd8-8da1-7c839074c194 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:46.009733 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-52e69def-2dfc-4cd8-8da1-7c839074c194 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] HTTP exception thrown: Invalid volume: volume 9e45a137-13fc-48f4-a71e-b22589766fb0 is already attached to instances: d7b368a5-aa99-45d7-a00d-c159874ba2be Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-52e69def-2dfc-4cd8-8da1-7c839074c194 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Request method failure captured: Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: POST /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/os-volume_attachments HTTP/1.1 Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 74 Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ_Mg9k-L2RVlFbeDrzZTKh-Rpkrdgjs5wXFw3RL8IjbBzyB1H1GE9m-bwqAzLYHlUBBVR_bizq5cOQPxjvYzlA4ulyNovSWUbczTq-xVO_3xhsRX-kwEtw0YkFnU6IHVIqD7ctMuC14fezNqmeoFr_4Iq_P1nZde-v4GK-exlCenjY Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:19:46.011392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:19:46.013151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fe9fc68075be4712a305fb8a15c91f19"}]}] Aug 29 19:19:46.013151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:19:46.013151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:19:46.013151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:19:46.013151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:19:46.013151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:19:46.013151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:19:46.013151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: a982dbba4a324a4f893e427000ce9b93 Aug 29 19:19:46.013151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:19:46.013151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Aug 29 19:19:46.013151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {"volumeAttachment": {"volumeId": "9e45a137-13fc-48f4-a71e-b22589766fb0"}} Aug 29 19:19:46.013151 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Invalid volume: volume 9e45a137-13fc-48f4-a71e-b22589766fb0 is already attached to instances: d7b368a5-aa99-45d7-a00d-c159874ba2be Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'server_id': 'd7b368a5-aa99-45d7-a00d-c159874ba2be', 'body': {'volumeAttachment': {'volumeId': '9e45a137-13fc-48f4-a71e-b22589766fb0'}}} Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9e45a137-13fc-48f4-a71e-b22589766fb0 is already attached to instances: d7b368a5-aa99-45d7-a00d-c159874ba2be Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:19:46.014019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9e45a137-13fc-48f4-a71e-b22589766fb0 is already attached to instances: d7b368a5-aa99-45d7-a00d-c159874ba2be Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:19:46.015498 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:19:46.016889 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:19:46.016889 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:19:46.016889 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:19:46.016889 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9e45a137-13fc-48f4-a71e-b22589766fb0 is already attached to instances: d7b368a5-aa99-45d7-a00d-c159874ba2be Aug 29 19:19:46.016889 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:19:46.018633 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-52e69def-2dfc-4cd8-8da1-7c839074c194 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Returning 400 to user: Invalid volume: volume 9e45a137-13fc-48f4-a71e-b22589766fb0 is already attached to instances: d7b368a5-aa99-45d7-a00d-c159874ba2be {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:19:46.019724 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-52e69def-2dfc-4cd8-8da1-7c839074c194 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "POST /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.135200 Aug 29 19:19:46.021039 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 624/1239] 10.222.0.86 () {60 vars in 1323 bytes} [Mon Aug 29 19:19:45 2022] POST /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/os-volume_attachments => generated 174 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:19:46.089566 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1b9cfda7-5296-4c12-8c6b-c3439cad46ad tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:46.090881 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1b9cfda7-5296-4c12-8c6b-c3439cad46ad tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:46.097724 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b9cfda7-5296-4c12-8c6b-c3439cad46ad tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:46.098329 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b9cfda7-5296-4c12-8c6b-c3439cad46ad tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:46.098938 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b9cfda7-5296-4c12-8c6b-c3439cad46ad tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:46.099762 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b9cfda7-5296-4c12-8c6b-c3439cad46ad tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:46.100472 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b9cfda7-5296-4c12-8c6b-c3439cad46ad tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:46.101067 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1b9cfda7-5296-4c12-8c6b-c3439cad46ad tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:46.215226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-1b9cfda7-5296-4c12-8c6b-c3439cad46ad tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lazy-loading 'services' on Instance uuid d7b368a5-aa99-45d7-a00d-c159874ba2be {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:19:46.308055 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1b9cfda7-5296-4c12-8c6b-c3439cad46ad tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "DELETE /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/os-volume_attachments/9e45a137-13fc-48f4-a71e-b22589766fb0" status: 202 len: 0 microversion: 2.1 time: 0.222818 Aug 29 19:19:46.309080 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 616/1240] 10.222.0.86 () {58 vars in 1416 bytes} [Mon Aug 29 19:19:46 2022] DELETE /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/os-volume_attachments/9e45a137-13fc-48f4-a71e-b22589766fb0 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:19:46.317822 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d172903d-12bd-4954-971a-a269f12ea6b9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:46.320899 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d172903d-12bd-4954-971a-a269f12ea6b9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:46.327410 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d172903d-12bd-4954-971a-a269f12ea6b9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:46.327898 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d172903d-12bd-4954-971a-a269f12ea6b9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:46.328527 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d172903d-12bd-4954-971a-a269f12ea6b9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:46.329522 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d172903d-12bd-4954-971a-a269f12ea6b9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:46.330054 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d172903d-12bd-4954-971a-a269f12ea6b9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:46.330975 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d172903d-12bd-4954-971a-a269f12ea6b9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:46.369357 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d172903d-12bd-4954-971a-a269f12ea6b9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055462 Aug 29 19:19:46.374030 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 625/1241] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:19:46 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:19:47.383573 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1ddbab0f-bbee-43d9-9436-03acf8e8f1c1 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:47.386672 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1ddbab0f-bbee-43d9-9436-03acf8e8f1c1 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:47.392946 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1ddbab0f-bbee-43d9-9436-03acf8e8f1c1 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:47.393549 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1ddbab0f-bbee-43d9-9436-03acf8e8f1c1 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:47.394005 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1ddbab0f-bbee-43d9-9436-03acf8e8f1c1 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:47.394670 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1ddbab0f-bbee-43d9-9436-03acf8e8f1c1 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:47.395144 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1ddbab0f-bbee-43d9-9436-03acf8e8f1c1 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:47.395558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1ddbab0f-bbee-43d9-9436-03acf8e8f1c1 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:47.425733 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1ddbab0f-bbee-43d9-9436-03acf8e8f1c1 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047765 Aug 29 19:19:47.426293 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 617/1242] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:19:47 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:19:48.438239 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1ec3b747-ea56-4b55-82ab-148a60388691 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:48.440381 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1ec3b747-ea56-4b55-82ab-148a60388691 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:48.447412 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ec3b747-ea56-4b55-82ab-148a60388691 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:48.447925 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ec3b747-ea56-4b55-82ab-148a60388691 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:48.448382 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ec3b747-ea56-4b55-82ab-148a60388691 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:48.449066 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ec3b747-ea56-4b55-82ab-148a60388691 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:48.449514 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ec3b747-ea56-4b55-82ab-148a60388691 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:48.449941 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ec3b747-ea56-4b55-82ab-148a60388691 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:48.478923 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1ec3b747-ea56-4b55-82ab-148a60388691 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044688 Aug 29 19:19:48.479508 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 626/1243] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:19:48 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:19:48.539963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0b47b812-9d31-406a-9f2b-8ebef402083e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:48.540515 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0b47b812-9d31-406a-9f2b-8ebef402083e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:48.546637 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0b47b812-9d31-406a-9f2b-8ebef402083e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:48.547160 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0b47b812-9d31-406a-9f2b-8ebef402083e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:48.547597 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0b47b812-9d31-406a-9f2b-8ebef402083e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:48.548286 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0b47b812-9d31-406a-9f2b-8ebef402083e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:48.548731 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0b47b812-9d31-406a-9f2b-8ebef402083e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:48.549150 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0b47b812-9d31-406a-9f2b-8ebef402083e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:48.574434 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0b47b812-9d31-406a-9f2b-8ebef402083e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:19:48.651024 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0b47b812-9d31-406a-9f2b-8ebef402083e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "DELETE /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 204 len: 0 microversion: 2.1 time: 0.114861 Aug 29 19:19:48.651648 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 618/1244] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:19:48 2022] DELETE /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:19:48.660020 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-82821fe4-8fdb-4fbb-a606-a71ff778edc7 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:48.660636 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-82821fe4-8fdb-4fbb-a606-a71ff778edc7 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:48.666511 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-82821fe4-8fdb-4fbb-a606-a71ff778edc7 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:48.667012 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-82821fe4-8fdb-4fbb-a606-a71ff778edc7 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:48.667486 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-82821fe4-8fdb-4fbb-a606-a71ff778edc7 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:48.668172 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-82821fe4-8fdb-4fbb-a606-a71ff778edc7 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:48.668621 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-82821fe4-8fdb-4fbb-a606-a71ff778edc7 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:48.669049 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-82821fe4-8fdb-4fbb-a606-a71ff778edc7 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:48.796117 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-82821fe4-8fdb-4fbb-a606-a71ff778edc7 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:19:48.803774 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-82821fe4-8fdb-4fbb-a606-a71ff778edc7 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1681 microversion: 2.1 time: 0.147667 Aug 29 19:19:48.804837 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 627/1245] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:19:48 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:19:49.825659 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-506b8a33-9535-4802-a42d-71e8a1f85c8b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:49.826346 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-506b8a33-9535-4802-a42d-71e8a1f85c8b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:49.832986 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-506b8a33-9535-4802-a42d-71e8a1f85c8b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:49.833456 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-506b8a33-9535-4802-a42d-71e8a1f85c8b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:49.833879 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-506b8a33-9535-4802-a42d-71e8a1f85c8b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:49.834556 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-506b8a33-9535-4802-a42d-71e8a1f85c8b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:49.835028 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-506b8a33-9535-4802-a42d-71e8a1f85c8b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:49.835439 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-506b8a33-9535-4802-a42d-71e8a1f85c8b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:49.964582 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-506b8a33-9535-4802-a42d-71e8a1f85c8b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:19:49.972228 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-506b8a33-9535-4802-a42d-71e8a1f85c8b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1681 microversion: 2.1 time: 0.150790 Aug 29 19:19:49.972791 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 619/1246] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:19:49 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:19:50.994343 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fbc24176-ee37-479c-8244-f2721142cc63 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:50.994957 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fbc24176-ee37-479c-8244-f2721142cc63 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:51.001396 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbc24176-ee37-479c-8244-f2721142cc63 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:51.001879 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbc24176-ee37-479c-8244-f2721142cc63 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:51.002315 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbc24176-ee37-479c-8244-f2721142cc63 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:51.003032 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbc24176-ee37-479c-8244-f2721142cc63 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:51.003477 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbc24176-ee37-479c-8244-f2721142cc63 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:51.003900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbc24176-ee37-479c-8244-f2721142cc63 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:51.210480 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fbc24176-ee37-479c-8244-f2721142cc63 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:19:51.218637 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fbc24176-ee37-479c-8244-f2721142cc63 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1681 microversion: 2.1 time: 0.228789 Aug 29 19:19:51.219237 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 628/1247] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:19:50 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:19:52.027273 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-71705775-3aff-43b2-a24e-d4b8079fb2fb req-b403c358-d87d-4b4f-9c70-c8f11844be0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7b368a5-aa99-45d7-a00d-c159874ba2be", "name": "network-vif-deleted", "tag": "60874621-e8cc-44fb-833b-c5064ce2a225"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:19:52.038003 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-71705775-3aff-43b2-a24e-d4b8079fb2fb req-b403c358-d87d-4b4f-9c70-c8f11844be0d service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:52.038429 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-71705775-3aff-43b2-a24e-d4b8079fb2fb req-b403c358-d87d-4b4f-9c70-c8f11844be0d service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:52.038860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-71705775-3aff-43b2-a24e-d4b8079fb2fb req-b403c358-d87d-4b4f-9c70-c8f11844be0d service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:52.051102 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-71705775-3aff-43b2-a24e-d4b8079fb2fb req-b403c358-d87d-4b4f-9c70-c8f11844be0d service nova] Creating event network-vif-deleted:60874621-e8cc-44fb-833b-c5064ce2a225 for instance d7b368a5-aa99-45d7-a00d-c159874ba2be on hv-cinder-85083 Aug 29 19:19:52.057609 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-71705775-3aff-43b2-a24e-d4b8079fb2fb req-b403c358-d87d-4b4f-9c70-c8f11844be0d service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034062 Aug 29 19:19:52.058458 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 620/1248] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:19:52.240534 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-30ff16b0-513b-47df-8175-9771cddf1343 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:52.241313 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-30ff16b0-513b-47df-8175-9771cddf1343 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:52.248506 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30ff16b0-513b-47df-8175-9771cddf1343 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:52.249019 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30ff16b0-513b-47df-8175-9771cddf1343 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:52.249457 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30ff16b0-513b-47df-8175-9771cddf1343 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:52.250157 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30ff16b0-513b-47df-8175-9771cddf1343 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:52.250612 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30ff16b0-513b-47df-8175-9771cddf1343 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:52.251058 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30ff16b0-513b-47df-8175-9771cddf1343 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:52.284537 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30ff16b0-513b-47df-8175-9771cddf1343 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:52.285017 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30ff16b0-513b-47df-8175-9771cddf1343 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:52.285510 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30ff16b0-513b-47df-8175-9771cddf1343 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:52.286054 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-30ff16b0-513b-47df-8175-9771cddf1343 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lazy-loading 'fault' on Instance uuid d7b368a5-aa99-45d7-a00d-c159874ba2be {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:19:52.326833 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-30ff16b0-513b-47df-8175-9771cddf1343 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:19:52.334685 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-30ff16b0-513b-47df-8175-9771cddf1343 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 200 len: 1331 microversion: 2.1 time: 0.098071 Aug 29 19:19:52.335284 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 629/1249] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:19:52 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:19:53.356768 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9e40d921-0229-4d81-a7d5-4c4f80e1916a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:53.357462 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9e40d921-0229-4d81-a7d5-4c4f80e1916a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:53.363525 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9e40d921-0229-4d81-a7d5-4c4f80e1916a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:53.364001 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9e40d921-0229-4d81-a7d5-4c4f80e1916a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:53.364422 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9e40d921-0229-4d81-a7d5-4c4f80e1916a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:53.365087 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9e40d921-0229-4d81-a7d5-4c4f80e1916a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:53.365533 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9e40d921-0229-4d81-a7d5-4c4f80e1916a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:53.365948 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9e40d921-0229-4d81-a7d5-4c4f80e1916a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:53.378874 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-9e40d921-0229-4d81-a7d5-4c4f80e1916a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] HTTP exception thrown: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9e40d921-0229-4d81-a7d5-4c4f80e1916a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Request method failure captured: Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be HTTP/1.1 Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ_Mg9k-L2RVlFbeDrzZTKh-Rpkrdgjs5wXFw3RL8IjbBzyB1H1GE9m-bwqAzLYHlUBBVR_bizq5cOQPxjvYzlA4ulyNovSWUbczTq-xVO_3xhsRX-kwEtw0YkFnU6IHVIqD7ctMuC14fezNqmeoFr_4Iq_P1nZde-v4GK-exlCenjY Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:19:53.380473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:19:53.382259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fe9fc68075be4712a305fb8a15c91f19"}]}] Aug 29 19:19:53.382259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:19:53.382259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:19:53.382259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:19:53.382259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:19:53.382259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:19:53.382259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:19:53.382259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: a982dbba4a324a4f893e427000ce9b93 Aug 29 19:19:53.382259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:19:53.382259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:19:53.382259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. Aug 29 19:19:53.382259 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': 'd7b368a5-aa99-45d7-a00d-c159874ba2be'} Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:19:53.383166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. Aug 29 19:19:53.385326 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:19:53.386869 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9e40d921-0229-4d81-a7d5-4c4f80e1916a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Returning 404 to user: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:19:53.386869 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9e40d921-0229-4d81-a7d5-4c4f80e1916a tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 404 len: 111 microversion: 2.1 time: 0.029778 Aug 29 19:19:53.386869 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 621/1250] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:19:53 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:19:53.391085 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1870904f-6af0-4e6f-ae65-3ce60a4ed6b0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '.version_select at 0x7fb2ba11b310>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:53.418320 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1870904f-6af0-4e6f-ae65-3ce60a4ed6b0 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007564638" status: 202 len: 0 microversion: 2.1 time: 0.030937 Aug 29 19:19:53.418903 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 630/1251] 10.222.0.86 () {58 vars in 1221 bytes} [Mon Aug 29 19:19:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007564638 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:19:54.053684 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1eec88df-48e8-4534-a01d-bc3ab7cc9eb6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Action: 'create', calling method: .version_select at 0x7fb2ba1e00d0>, body: {"keypair": {"name": "tempest-keypair-1017745898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3BiryfDrzPggTKb0WEzBCASfn4hiaB7tNz5qK3Pz/VP0pYKXujugVps1n6q6FQ15B1lqlQzVkDXJU5s78dXD30dvpmyd87pmLPoyIODvqi63Z1cpewvESP8OgVmppUSg=="}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:19:54.069684 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-1eec88df-48e8-4534-a01d-bc3ab7cc9eb6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Getting quotas for project fe9fc68075be4712a305fb8a15c91f19. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:19:54.073526 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-1eec88df-48e8-4534-a01d-bc3ab7cc9eb6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Getting quotas for user a982dbba4a324a4f893e427000ce9b93 and project fe9fc68075be4712a305fb8a15c91f19. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:19:54.095352 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1eec88df-48e8-4534-a01d-bc3ab7cc9eb6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045512 Aug 29 19:19:54.095930 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 622/1252] 10.222.0.86 () {60 vars in 1159 bytes} [Mon Aug 29 19:19:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:19:55.343298 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-163379446", "imageRef": "861f5907-70c3-43d5-ac9c-e48d370a892f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c198086-2b12-4afa-9f22-a31dfbf52cb2"}], "security_groups": [{"name": "tempest-securitygroup--1128833817"}], "key_name": "tempest-keypair-1017745898", "user_data": "}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:19:55.448665 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] validate_networks() for [('2c198086-2b12-4afa-9f22-a31dfbf52cb2', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:19:55.812859 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:19:55.813291 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:19:55.813764 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:19:55.814172 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:19:55.814581 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:19:55.823444 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:55.823923 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:55.824354 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:55.825075 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:55.825525 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:55.825944 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:55.842675 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Getting quotas for project fe9fc68075be4712a305fb8a15c91f19. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:19:55.846607 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Getting quotas for user a982dbba4a324a4f893e427000ce9b93 and project fe9fc68075be4712a305fb8a15c91f19. Resources: {'cores', 'ram', 'instances'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:19:55.858037 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:19:55.860339 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='861f5907-70c3-43d5-ac9c-e48d370a892f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:19:55.909136 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-410c54a4-ffe4-41d4-9830-32f1daefb1ca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.570597 Aug 29 19:19:55.909780 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 631/1253] 10.222.0.86 () {60 vars in 1147 bytes} [Mon Aug 29 19:19:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:19:55.922083 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-387034d5-334d-4520-917a-19cf34f05f2d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:55.922783 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-387034d5-334d-4520-917a-19cf34f05f2d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:55.978808 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-387034d5-334d-4520-917a-19cf34f05f2d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:19:55.985557 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-387034d5-334d-4520-917a-19cf34f05f2d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 200 len: 1241 microversion: 2.1 time: 0.068209 Aug 29 19:19:55.986111 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 623/1254] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:19:55 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:19:57.006352 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6a57d3c4-9d4b-4c67-8f0d-7ad23887b662 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:57.007009 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6a57d3c4-9d4b-4c67-8f0d-7ad23887b662 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:57.014303 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a57d3c4-9d4b-4c67-8f0d-7ad23887b662 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:57.014792 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a57d3c4-9d4b-4c67-8f0d-7ad23887b662 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:57.015273 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a57d3c4-9d4b-4c67-8f0d-7ad23887b662 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:57.015969 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a57d3c4-9d4b-4c67-8f0d-7ad23887b662 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:57.016428 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a57d3c4-9d4b-4c67-8f0d-7ad23887b662 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:57.016859 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6a57d3c4-9d4b-4c67-8f0d-7ad23887b662 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:57.078622 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6a57d3c4-9d4b-4c67-8f0d-7ad23887b662 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:19:57.087187 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6a57d3c4-9d4b-4c67-8f0d-7ad23887b662 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 200 len: 1293 microversion: 2.1 time: 0.084776 Aug 29 19:19:57.087755 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 632/1255] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:19:57 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:19:58.108411 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-89de6c01-facf-438e-8c71-c4e29df4888e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:58.109615 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-89de6c01-facf-438e-8c71-c4e29df4888e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:58.116243 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-89de6c01-facf-438e-8c71-c4e29df4888e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:58.116947 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-89de6c01-facf-438e-8c71-c4e29df4888e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:58.117380 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-89de6c01-facf-438e-8c71-c4e29df4888e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:58.118072 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-89de6c01-facf-438e-8c71-c4e29df4888e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:58.118521 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-89de6c01-facf-438e-8c71-c4e29df4888e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:58.119140 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-89de6c01-facf-438e-8c71-c4e29df4888e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:58.123381 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:58.372603 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-89de6c01-facf-438e-8c71-c4e29df4888e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:19:58.380815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-89de6c01-facf-438e-8c71-c4e29df4888e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 200 len: 1367 microversion: 2.1 time: 0.276225 Aug 29 19:19:58.381383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 624/1256] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:19:58 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:19:58.818495 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-29689d4a-cce9-4e93-964c-15e8d60cae35 req-080670a8-ac7c-4563-9132-86d0389e5706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02876adc-c31e-4c4d-9523-2dba3515274a", "tag": "e281ba0f-c6f1-4a52-8768-360e4258d8f8"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:19:58.828465 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-29689d4a-cce9-4e93-964c-15e8d60cae35 req-080670a8-ac7c-4563-9132-86d0389e5706 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:58.829013 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-29689d4a-cce9-4e93-964c-15e8d60cae35 req-080670a8-ac7c-4563-9132-86d0389e5706 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:58.829510 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-29689d4a-cce9-4e93-964c-15e8d60cae35 req-080670a8-ac7c-4563-9132-86d0389e5706 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:58.841003 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-29689d4a-cce9-4e93-964c-15e8d60cae35 req-080670a8-ac7c-4563-9132-86d0389e5706 service nova] Creating event network-changed:e281ba0f-c6f1-4a52-8768-360e4258d8f8 for instance 02876adc-c31e-4c4d-9523-2dba3515274a on hv-cinder-85083 Aug 29 19:19:58.846035 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-29689d4a-cce9-4e93-964c-15e8d60cae35 req-080670a8-ac7c-4563-9132-86d0389e5706 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195420 Aug 29 19:19:58.846822 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 633/1257] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:19:59.401739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-73cfaac4-5b92-4995-acd2-f9f4a5bc7e31 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:59.402343 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-73cfaac4-5b92-4995-acd2-f9f4a5bc7e31 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:59.408749 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73cfaac4-5b92-4995-acd2-f9f4a5bc7e31 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:59.409267 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73cfaac4-5b92-4995-acd2-f9f4a5bc7e31 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:59.409698 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73cfaac4-5b92-4995-acd2-f9f4a5bc7e31 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:59.410382 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73cfaac4-5b92-4995-acd2-f9f4a5bc7e31 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:59.410901 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73cfaac4-5b92-4995-acd2-f9f4a5bc7e31 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:59.411279 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-73cfaac4-5b92-4995-acd2-f9f4a5bc7e31 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:59.537576 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-73cfaac4-5b92-4995-acd2-f9f4a5bc7e31 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:19:59.545233 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-73cfaac4-5b92-4995-acd2-f9f4a5bc7e31 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 200 len: 1367 microversion: 2.1 time: 0.147382 Aug 29 19:19:59.545804 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 625/1258] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:19:59 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:00.566313 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d2612648-c7dd-480c-a54e-5e6f13947754 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:00.567031 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d2612648-c7dd-480c-a54e-5e6f13947754 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:00.569503 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:00.575580 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2612648-c7dd-480c-a54e-5e6f13947754 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:00.576056 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2612648-c7dd-480c-a54e-5e6f13947754 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:00.576486 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2612648-c7dd-480c-a54e-5e6f13947754 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:00.577166 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2612648-c7dd-480c-a54e-5e6f13947754 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:00.577612 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2612648-c7dd-480c-a54e-5e6f13947754 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:00.578029 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2612648-c7dd-480c-a54e-5e6f13947754 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:00.581765 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:00.714949 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d2612648-c7dd-480c-a54e-5e6f13947754 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:00.722416 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d2612648-c7dd-480c-a54e-5e6f13947754 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 200 len: 1367 microversion: 2.1 time: 0.160532 Aug 29 19:20:00.722972 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 634/1259] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:00 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:01.743513 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-21e86a3b-4e22-4e61-9da3-02ef929c9b6b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:01.744702 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-21e86a3b-4e22-4e61-9da3-02ef929c9b6b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:01.746564 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:01.751937 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-21e86a3b-4e22-4e61-9da3-02ef929c9b6b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:01.752421 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-21e86a3b-4e22-4e61-9da3-02ef929c9b6b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:01.752850 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-21e86a3b-4e22-4e61-9da3-02ef929c9b6b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:01.753542 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-21e86a3b-4e22-4e61-9da3-02ef929c9b6b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:01.753984 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-21e86a3b-4e22-4e61-9da3-02ef929c9b6b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:01.754397 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-21e86a3b-4e22-4e61-9da3-02ef929c9b6b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:01.974411 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-21e86a3b-4e22-4e61-9da3-02ef929c9b6b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:01.982889 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-21e86a3b-4e22-4e61-9da3-02ef929c9b6b tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 200 len: 1367 microversion: 2.1 time: 0.243816 Aug 29 19:20:01.983499 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 626/1260] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:01 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:03.003824 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-90226a95-6d12-464b-a88f-e194ac09df78 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:03.004392 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-90226a95-6d12-464b-a88f-e194ac09df78 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:03.011472 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-90226a95-6d12-464b-a88f-e194ac09df78 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:03.011953 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-90226a95-6d12-464b-a88f-e194ac09df78 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:03.012385 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-90226a95-6d12-464b-a88f-e194ac09df78 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:03.013081 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-90226a95-6d12-464b-a88f-e194ac09df78 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:03.013528 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-90226a95-6d12-464b-a88f-e194ac09df78 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:03.013950 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-90226a95-6d12-464b-a88f-e194ac09df78 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:03.140942 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-90226a95-6d12-464b-a88f-e194ac09df78 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:03.148572 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-90226a95-6d12-464b-a88f-e194ac09df78 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 200 len: 1367 microversion: 2.1 time: 0.148763 Aug 29 19:20:03.149124 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 635/1261] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:02 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:04.168603 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a31e9092-9016-4270-b823-7651b9a358fb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:04.169210 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a31e9092-9016-4270-b823-7651b9a358fb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:04.175895 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a31e9092-9016-4270-b823-7651b9a358fb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:04.176380 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a31e9092-9016-4270-b823-7651b9a358fb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:04.176815 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a31e9092-9016-4270-b823-7651b9a358fb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:04.177579 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a31e9092-9016-4270-b823-7651b9a358fb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:04.177958 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a31e9092-9016-4270-b823-7651b9a358fb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:04.178379 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a31e9092-9016-4270-b823-7651b9a358fb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:04.310894 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a31e9092-9016-4270-b823-7651b9a358fb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:04.318464 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a31e9092-9016-4270-b823-7651b9a358fb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 200 len: 1367 microversion: 2.1 time: 0.153814 Aug 29 19:20:04.319045 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 627/1262] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:04 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:04.870458 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-898a6ca2-6cc0-49a0-a3e0-d01da7963b58 req-ef575a42-437c-4736-ad72-ce6d546b20ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02876adc-c31e-4c4d-9523-2dba3515274a", "name": "network-vif-plugged", "status": "completed", "tag": "e281ba0f-c6f1-4a52-8768-360e4258d8f8"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:20:04.880904 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-898a6ca2-6cc0-49a0-a3e0-d01da7963b58 req-ef575a42-437c-4736-ad72-ce6d546b20ab service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:04.881375 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-898a6ca2-6cc0-49a0-a3e0-d01da7963b58 req-ef575a42-437c-4736-ad72-ce6d546b20ab service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:04.881840 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-898a6ca2-6cc0-49a0-a3e0-d01da7963b58 req-ef575a42-437c-4736-ad72-ce6d546b20ab service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:04.892931 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-898a6ca2-6cc0-49a0-a3e0-d01da7963b58 req-ef575a42-437c-4736-ad72-ce6d546b20ab service nova] Creating event network-vif-plugged:e281ba0f-c6f1-4a52-8768-360e4258d8f8 for instance 02876adc-c31e-4c4d-9523-2dba3515274a on hv-cinder-85083 Aug 29 19:20:04.897894 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-898a6ca2-6cc0-49a0-a3e0-d01da7963b58 req-ef575a42-437c-4736-ad72-ce6d546b20ab service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031118 Aug 29 19:20:04.898493 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 636/1263] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:20:05.340224 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-57ab895d-d102-478c-8459-f3328c34e716 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:05.340838 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-57ab895d-d102-478c-8459-f3328c34e716 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:05.348063 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57ab895d-d102-478c-8459-f3328c34e716 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:05.348543 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57ab895d-d102-478c-8459-f3328c34e716 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:05.348975 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57ab895d-d102-478c-8459-f3328c34e716 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:05.349664 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57ab895d-d102-478c-8459-f3328c34e716 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:05.350111 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57ab895d-d102-478c-8459-f3328c34e716 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:05.350531 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57ab895d-d102-478c-8459-f3328c34e716 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:05.479558 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-57ab895d-d102-478c-8459-f3328c34e716 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:05.487075 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-57ab895d-d102-478c-8459-f3328c34e716 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 200 len: 1367 microversion: 2.1 time: 0.151300 Aug 29 19:20:05.487675 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 628/1264] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:05 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:06.505545 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:06.506299 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=6 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:06.512139 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6046a4ca-8294-4882-b0c9-5a2e3312e068 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:06.512838 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6046a4ca-8294-4882-b0c9-5a2e3312e068 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:06.520802 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6046a4ca-8294-4882-b0c9-5a2e3312e068 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:06.521291 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6046a4ca-8294-4882-b0c9-5a2e3312e068 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:06.521723 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6046a4ca-8294-4882-b0c9-5a2e3312e068 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:06.522423 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6046a4ca-8294-4882-b0c9-5a2e3312e068 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:06.522872 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6046a4ca-8294-4882-b0c9-5a2e3312e068 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:06.523362 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6046a4ca-8294-4882-b0c9-5a2e3312e068 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:06.654417 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6046a4ca-8294-4882-b0c9-5a2e3312e068 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:06.662194 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6046a4ca-8294-4882-b0c9-5a2e3312e068 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 200 len: 1367 microversion: 2.1 time: 0.157577 Aug 29 19:20:06.662757 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 637/1265] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:06 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:07.683995 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c3539bf8-829a-4851-99d3-9c26a5d532c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:07.684531 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c3539bf8-829a-4851-99d3-9c26a5d532c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:07.686356 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:07.691963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3539bf8-829a-4851-99d3-9c26a5d532c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:07.692444 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3539bf8-829a-4851-99d3-9c26a5d532c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:07.692875 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3539bf8-829a-4851-99d3-9c26a5d532c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:07.693565 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3539bf8-829a-4851-99d3-9c26a5d532c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:07.694012 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3539bf8-829a-4851-99d3-9c26a5d532c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:07.694431 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3539bf8-829a-4851-99d3-9c26a5d532c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:07.821492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c3539bf8-829a-4851-99d3-9c26a5d532c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:07.829076 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c3539bf8-829a-4851-99d3-9c26a5d532c6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 200 len: 1556 microversion: 2.1 time: 0.149496 Aug 29 19:20:07.829643 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 629/1266] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:07 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:07.849874 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5841e488-d824-4f3e-9946-eb72a62aee90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:07.850400 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5841e488-d824-4f3e-9946-eb72a62aee90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:07.857551 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5841e488-d824-4f3e-9946-eb72a62aee90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:07.858029 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5841e488-d824-4f3e-9946-eb72a62aee90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:07.858562 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5841e488-d824-4f3e-9946-eb72a62aee90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:07.859279 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5841e488-d824-4f3e-9946-eb72a62aee90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:07.859725 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5841e488-d824-4f3e-9946-eb72a62aee90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:07.860146 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5841e488-d824-4f3e-9946-eb72a62aee90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:07.934595 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5841e488-d824-4f3e-9946-eb72a62aee90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088304 Aug 29 19:20:07.935163 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 638/1267] 10.222.0.86 () {58 vars in 1275 bytes} [Mon Aug 29 19:20:07 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:20:09.105166 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-06332529-6f89-4cf0-aec5-319d89f5feff req-bc71f172-1a1d-422d-a00a-7a179d6af4ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02876adc-c31e-4c4d-9523-2dba3515274a", "tag": "e281ba0f-c6f1-4a52-8768-360e4258d8f8"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:20:09.115446 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-06332529-6f89-4cf0-aec5-319d89f5feff req-bc71f172-1a1d-422d-a00a-7a179d6af4ca service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:09.115928 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-06332529-6f89-4cf0-aec5-319d89f5feff req-bc71f172-1a1d-422d-a00a-7a179d6af4ca service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:09.116357 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-06332529-6f89-4cf0-aec5-319d89f5feff req-bc71f172-1a1d-422d-a00a-7a179d6af4ca service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:09.128530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-06332529-6f89-4cf0-aec5-319d89f5feff req-bc71f172-1a1d-422d-a00a-7a179d6af4ca service nova] Creating event network-changed:e281ba0f-c6f1-4a52-8768-360e4258d8f8 for instance 02876adc-c31e-4c4d-9523-2dba3515274a on hv-cinder-85083 Aug 29 19:20:09.135630 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-06332529-6f89-4cf0-aec5-319d89f5feff req-bc71f172-1a1d-422d-a00a-7a179d6af4ca service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034011 Aug 29 19:20:09.136616 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 630/1268] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:21:35.418430 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=9 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:35.419189 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=23 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:35.423860 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0e0d18e3-4ad7-4f97-b92a-47bbf56c41cb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:35.424332 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0e0d18e3-4ad7-4f97-b92a-47bbf56c41cb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:35.431749 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e0d18e3-4ad7-4f97-b92a-47bbf56c41cb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:35.432222 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e0d18e3-4ad7-4f97-b92a-47bbf56c41cb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:35.432651 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e0d18e3-4ad7-4f97-b92a-47bbf56c41cb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:35.433358 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e0d18e3-4ad7-4f97-b92a-47bbf56c41cb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:35.433805 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e0d18e3-4ad7-4f97-b92a-47bbf56c41cb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:35.434220 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e0d18e3-4ad7-4f97-b92a-47bbf56c41cb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:35.459330 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0e0d18e3-4ad7-4f97-b92a-47bbf56c41cb tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a/ips" status: 200 len: 147 microversion: 2.1 time: 0.042914 Aug 29 19:21:35.459896 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 639/1269] 10.222.0.86 () {58 vars in 1248 bytes} [Mon Aug 29 19:21:35 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a/ips => generated 147 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:21:36.793237 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=9 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:36.793964 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=36 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:36.795141 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 19:21:36.795373 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Mon Aug 29 19:21:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a/os-volume_attachments (ip 10.222.0.86) !!! Aug 29 19:21:36.801038 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-431292c7-92c2-4252-b325-da3bc876eb97 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82b5f3a5-cd95-4ca7-ba73-3e8ffe8bfcec"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:21:36.803480 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-431292c7-92c2-4252-b325-da3bc876eb97 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:36.811210 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-431292c7-92c2-4252-b325-da3bc876eb97 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:36.811690 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-431292c7-92c2-4252-b325-da3bc876eb97 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:36.812121 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-431292c7-92c2-4252-b325-da3bc876eb97 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:36.812802 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-431292c7-92c2-4252-b325-da3bc876eb97 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:36.813254 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-431292c7-92c2-4252-b325-da3bc876eb97 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:36.813678 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-431292c7-92c2-4252-b325-da3bc876eb97 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:37.079309 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-431292c7-92c2-4252-b325-da3bc876eb97 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "POST /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289009 Aug 29 19:21:37.082191 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 631/1270] 10.222.0.86 () {60 vars in 1323 bytes} [Mon Aug 29 19:21:36 2022] POST /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:21:44.690578 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c694fef7-065e-4e27-85a7-b1fe2aef448e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:44.691104 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c694fef7-065e-4e27-85a7-b1fe2aef448e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:44.698504 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c694fef7-065e-4e27-85a7-b1fe2aef448e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:44.699011 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c694fef7-065e-4e27-85a7-b1fe2aef448e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:44.699450 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c694fef7-065e-4e27-85a7-b1fe2aef448e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:44.700132 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c694fef7-065e-4e27-85a7-b1fe2aef448e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:44.700582 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c694fef7-065e-4e27-85a7-b1fe2aef448e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:44.701001 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c694fef7-065e-4e27-85a7-b1fe2aef448e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:44.903087 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-c694fef7-065e-4e27-85a7-b1fe2aef448e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lazy-loading 'services' on Instance uuid 02876adc-c31e-4c4d-9523-2dba3515274a {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:21:44.972990 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c694fef7-065e-4e27-85a7-b1fe2aef448e tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "DELETE /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a/os-volume_attachments/82b5f3a5-cd95-4ca7-ba73-3e8ffe8bfcec" status: 202 len: 0 microversion: 2.1 time: 0.286103 Aug 29 19:21:44.973569 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 640/1271] 10.222.0.86 () {58 vars in 1416 bytes} [Mon Aug 29 19:21:44 2022] DELETE /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a/os-volume_attachments/82b5f3a5-cd95-4ca7-ba73-3e8ffe8bfcec => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:21:44.983076 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2a077904-13dd-4a69-856f-6d584d436144 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:44.985392 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2a077904-13dd-4a69-856f-6d584d436144 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:44.992400 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a077904-13dd-4a69-856f-6d584d436144 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:44.992590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a077904-13dd-4a69-856f-6d584d436144 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:44.993478 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a077904-13dd-4a69-856f-6d584d436144 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:44.994185 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a077904-13dd-4a69-856f-6d584d436144 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:44.994635 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a077904-13dd-4a69-856f-6d584d436144 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:44.995110 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2a077904-13dd-4a69-856f-6d584d436144 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:45.025659 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2a077904-13dd-4a69-856f-6d584d436144 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047318 Aug 29 19:21:45.026223 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 632/1272] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:21:44 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:21:46.039061 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-14ec23bd-49e8-44b2-ac9b-8308ebfcf93c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:46.041390 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-14ec23bd-49e8-44b2-ac9b-8308ebfcf93c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:46.047664 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14ec23bd-49e8-44b2-ac9b-8308ebfcf93c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:46.048144 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14ec23bd-49e8-44b2-ac9b-8308ebfcf93c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:46.048581 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14ec23bd-49e8-44b2-ac9b-8308ebfcf93c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:46.049354 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14ec23bd-49e8-44b2-ac9b-8308ebfcf93c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:46.049799 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14ec23bd-49e8-44b2-ac9b-8308ebfcf93c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:46.050218 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14ec23bd-49e8-44b2-ac9b-8308ebfcf93c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:46.078760 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-14ec23bd-49e8-44b2-ac9b-8308ebfcf93c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044581 Aug 29 19:21:46.079253 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 641/1273] 10.222.0.86 () {58 vars in 1302 bytes} [Mon Aug 29 19:21:46 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:21:46.140556 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e4bf7d15-7289-4f73-9784-e9cb41605f54 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:46.141065 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e4bf7d15-7289-4f73-9784-e9cb41605f54 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:46.147566 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e4bf7d15-7289-4f73-9784-e9cb41605f54 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:46.148043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e4bf7d15-7289-4f73-9784-e9cb41605f54 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:46.148473 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e4bf7d15-7289-4f73-9784-e9cb41605f54 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:46.149754 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e4bf7d15-7289-4f73-9784-e9cb41605f54 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:46.150203 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e4bf7d15-7289-4f73-9784-e9cb41605f54 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:46.150626 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e4bf7d15-7289-4f73-9784-e9cb41605f54 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:46.175077 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e4bf7d15-7289-4f73-9784-e9cb41605f54 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:21:46.248926 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e4bf7d15-7289-4f73-9784-e9cb41605f54 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "DELETE /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 204 len: 0 microversion: 2.1 time: 0.112119 Aug 29 19:21:46.249526 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 633/1274] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:21:46 2022] DELETE /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:21:46.257951 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6237db17-264a-48ca-9013-bd865c18ddb6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:46.259302 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6237db17-264a-48ca-9013-bd865c18ddb6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:46.265269 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6237db17-264a-48ca-9013-bd865c18ddb6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:46.265754 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6237db17-264a-48ca-9013-bd865c18ddb6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:46.266189 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6237db17-264a-48ca-9013-bd865c18ddb6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:46.266875 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6237db17-264a-48ca-9013-bd865c18ddb6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:46.267378 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6237db17-264a-48ca-9013-bd865c18ddb6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:46.267804 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6237db17-264a-48ca-9013-bd865c18ddb6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:46.404695 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6237db17-264a-48ca-9013-bd865c18ddb6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:46.412956 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6237db17-264a-48ca-9013-bd865c18ddb6 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 200 len: 1679 microversion: 2.1 time: 0.158748 Aug 29 19:21:46.413750 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 642/1275] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:46 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:47.435828 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4681b58d-2a5a-474a-88e3-243a9a287a90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:47.436557 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4681b58d-2a5a-474a-88e3-243a9a287a90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:47.442981 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4681b58d-2a5a-474a-88e3-243a9a287a90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:47.443483 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4681b58d-2a5a-474a-88e3-243a9a287a90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:47.443906 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4681b58d-2a5a-474a-88e3-243a9a287a90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:47.444583 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4681b58d-2a5a-474a-88e3-243a9a287a90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:47.445025 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4681b58d-2a5a-474a-88e3-243a9a287a90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:47.445437 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4681b58d-2a5a-474a-88e3-243a9a287a90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:47.690887 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4681b58d-2a5a-474a-88e3-243a9a287a90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:47.698646 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4681b58d-2a5a-474a-88e3-243a9a287a90 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 200 len: 1679 microversion: 2.1 time: 0.267125 Aug 29 19:21:47.699302 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 634/1276] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:47 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 1679 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:48.720623 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-917538d8-b292-4f89-b042-83b6c8ad3083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:48.721226 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-917538d8-b292-4f89-b042-83b6c8ad3083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:48.728240 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-917538d8-b292-4f89-b042-83b6c8ad3083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:48.728713 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-917538d8-b292-4f89-b042-83b6c8ad3083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:48.729140 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-917538d8-b292-4f89-b042-83b6c8ad3083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:48.729824 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-917538d8-b292-4f89-b042-83b6c8ad3083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:48.730270 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-917538d8-b292-4f89-b042-83b6c8ad3083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:48.730691 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-917538d8-b292-4f89-b042-83b6c8ad3083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:48.967338 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-917538d8-b292-4f89-b042-83b6c8ad3083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:48.974937 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-917538d8-b292-4f89-b042-83b6c8ad3083 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 200 len: 1679 microversion: 2.1 time: 0.258156 Aug 29 19:21:48.975533 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 643/1277] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:48 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 1679 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:49.624433 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-be8ecc8a-5b39-4e8c-bf9f-1a5c706d80ac req-fe6120a5-ae15-42fd-8ff2-5d1d197afee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02876adc-c31e-4c4d-9523-2dba3515274a", "name": "network-vif-deleted", "tag": "e281ba0f-c6f1-4a52-8768-360e4258d8f8"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:21:49.634970 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-be8ecc8a-5b39-4e8c-bf9f-1a5c706d80ac req-fe6120a5-ae15-42fd-8ff2-5d1d197afee0 service nova] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:49.635559 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-be8ecc8a-5b39-4e8c-bf9f-1a5c706d80ac req-fe6120a5-ae15-42fd-8ff2-5d1d197afee0 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:49.636006 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-be8ecc8a-5b39-4e8c-bf9f-1a5c706d80ac req-fe6120a5-ae15-42fd-8ff2-5d1d197afee0 service nova] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:49.647226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-be8ecc8a-5b39-4e8c-bf9f-1a5c706d80ac req-fe6120a5-ae15-42fd-8ff2-5d1d197afee0 service nova] Creating event network-vif-deleted:e281ba0f-c6f1-4a52-8768-360e4258d8f8 for instance 02876adc-c31e-4c4d-9523-2dba3515274a on hv-cinder-85083 Aug 29 19:21:49.654928 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-be8ecc8a-5b39-4e8c-bf9f-1a5c706d80ac req-fe6120a5-ae15-42fd-8ff2-5d1d197afee0 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035206 Aug 29 19:21:49.656144 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 635/1278] 10.222.0.86 () {64 vars in 1317 bytes} [Mon Aug 29 19:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:21:49.996196 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ab9b2918-9b8d-433f-8aa4-e02a32801ec9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:49.996765 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ab9b2918-9b8d-433f-8aa4-e02a32801ec9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:50.003715 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab9b2918-9b8d-433f-8aa4-e02a32801ec9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:50.004230 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab9b2918-9b8d-433f-8aa4-e02a32801ec9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:50.004663 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab9b2918-9b8d-433f-8aa4-e02a32801ec9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:50.005362 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab9b2918-9b8d-433f-8aa4-e02a32801ec9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:50.005812 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab9b2918-9b8d-433f-8aa4-e02a32801ec9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:50.006230 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab9b2918-9b8d-433f-8aa4-e02a32801ec9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:50.040637 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab9b2918-9b8d-433f-8aa4-e02a32801ec9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:50.041115 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab9b2918-9b8d-433f-8aa4-e02a32801ec9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:50.041544 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab9b2918-9b8d-433f-8aa4-e02a32801ec9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:50.041992 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-ab9b2918-9b8d-433f-8aa4-e02a32801ec9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lazy-loading 'fault' on Instance uuid 02876adc-c31e-4c4d-9523-2dba3515274a {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:21:50.084355 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ab9b2918-9b8d-433f-8aa4-e02a32801ec9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a982dbba4a324a4f893e427000ce9b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9fc68075be4712a305fb8a15c91f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:50.092887 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ab9b2918-9b8d-433f-8aa4-e02a32801ec9 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 200 len: 1331 microversion: 2.1 time: 0.100596 Aug 29 19:21:50.093466 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 644/1279] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:49 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:51.114640 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a5a74b3d-9e48-4f84-a5a2-4c4f05dcdadc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:51.115353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a5a74b3d-9e48-4f84-a5a2-4c4f05dcdadc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:51.122073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a5a74b3d-9e48-4f84-a5a2-4c4f05dcdadc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:51.122566 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a5a74b3d-9e48-4f84-a5a2-4c4f05dcdadc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:51.122976 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a5a74b3d-9e48-4f84-a5a2-4c4f05dcdadc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:51.123678 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a5a74b3d-9e48-4f84-a5a2-4c4f05dcdadc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:51.124123 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a5a74b3d-9e48-4f84-a5a2-4c4f05dcdadc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:51.124540 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a5a74b3d-9e48-4f84-a5a2-4c4f05dcdadc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:51.137470 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-a5a74b3d-9e48-4f84-a5a2-4c4f05dcdadc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] HTTP exception thrown: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a5a74b3d-9e48-4f84-a5a2-4c4f05dcdadc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Request method failure captured: Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a HTTP/1.1 Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ_Mg9k-L2RVlFbeDrzZTKh-Rpkrdgjs5wXFw3RL8IjbBzyB1H1GE9m-bwqAzLYHlUBBVR_bizq5cOQPxjvYzlA4ulyNovSWUbczTq-xVO_3xhsRX-kwEtw0YkFnU6IHVIqD7ctMuC14fezNqmeoFr_4Iq_P1nZde-v4GK-exlCenjY Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:21:51.139073 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:21:51.140829 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fe9fc68075be4712a305fb8a15c91f19"}]}] Aug 29 19:21:51.140829 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:51.140829 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:51.140829 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:51.140829 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:51.140829 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:21:51.140829 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:21:51.140829 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: a982dbba4a324a4f893e427000ce9b93 Aug 29 19:21:51.140829 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:51.140829 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:21:51.140829 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. Aug 29 19:21:51.140829 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': '02876adc-c31e-4c4d-9523-2dba3515274a'} Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:21:51.141844 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. Aug 29 19:21:51.143590 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:51.145024 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a5a74b3d-9e48-4f84-a5a2-4c4f05dcdadc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Returning 404 to user: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:21:51.145024 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a5a74b3d-9e48-4f84-a5a2-4c4f05dcdadc tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 404 len: 111 microversion: 2.1 time: 0.030483 Aug 29 19:21:51.145024 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 636/1280] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:51 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:21:51.149332 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d165e1d5-da48-480a-9dbc-c7b63dd6fa60 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '.version_select at 0x7fb2b9fcf310>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:51.168232 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d165e1d5-da48-480a-9dbc-c7b63dd6fa60 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017745898" status: 202 len: 0 microversion: 2.1 time: 0.022698 Aug 29 19:21:51.168787 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 645/1281] 10.222.0.86 () {58 vars in 1221 bytes} [Mon Aug 29 19:21:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017745898 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:21:52.944917 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-09492087-dfcc-4f91-b097-40aa3106413c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:52.945424 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-09492087-dfcc-4f91-b097-40aa3106413c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:52.952147 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-09492087-dfcc-4f91-b097-40aa3106413c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:52.952622 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-09492087-dfcc-4f91-b097-40aa3106413c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:52.953046 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-09492087-dfcc-4f91-b097-40aa3106413c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:52.953722 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-09492087-dfcc-4f91-b097-40aa3106413c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:52.954165 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-09492087-dfcc-4f91-b097-40aa3106413c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:52.954582 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-09492087-dfcc-4f91-b097-40aa3106413c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:52.968588 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-09492087-dfcc-4f91-b097-40aa3106413c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] HTTP exception thrown: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-09492087-dfcc-4f91-b097-40aa3106413c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Request method failure captured: Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: DELETE /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a HTTP/1.1 Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ_Mg9k-L2RVlFbeDrzZTKh-Rpkrdgjs5wXFw3RL8IjbBzyB1H1GE9m-bwqAzLYHlUBBVR_bizq5cOQPxjvYzlA4ulyNovSWUbczTq-xVO_3xhsRX-kwEtw0YkFnU6IHVIqD7ctMuC14fezNqmeoFr_4Iq_P1nZde-v4GK-exlCenjY Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:21:52.970088 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:21:52.972048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fe9fc68075be4712a305fb8a15c91f19"}]}] Aug 29 19:21:52.972048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:52.972048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:52.972048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:52.972048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:52.972048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:21:52.972048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:21:52.972048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: a982dbba4a324a4f893e427000ce9b93 Aug 29 19:21:52.972048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:52.972048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:21:52.972048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. Aug 29 19:21:52.972048 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': '02876adc-c31e-4c4d-9523-2dba3515274a'} Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:21:52.973043 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. Aug 29 19:21:52.974739 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:52.976376 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-09492087-dfcc-4f91-b097-40aa3106413c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Returning 404 to user: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:21:52.976376 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-09492087-dfcc-4f91-b097-40aa3106413c tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "DELETE /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 404 len: 111 microversion: 2.1 time: 0.030324 Aug 29 19:21:52.976376 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 637/1282] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:21:52 2022] DELETE /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:21:52.980302 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ec72b6b9-de07-46a0-ad9c-9237381f099d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:52.980972 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ec72b6b9-de07-46a0-ad9c-9237381f099d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: 02876adc-c31e-4c4d-9523-2dba3515274a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:52.987612 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec72b6b9-de07-46a0-ad9c-9237381f099d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:52.988097 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec72b6b9-de07-46a0-ad9c-9237381f099d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:52.988531 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec72b6b9-de07-46a0-ad9c-9237381f099d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:52.989215 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec72b6b9-de07-46a0-ad9c-9237381f099d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:52.989673 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec72b6b9-de07-46a0-ad9c-9237381f099d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:52.990095 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec72b6b9-de07-46a0-ad9c-9237381f099d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:53.003518 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-ec72b6b9-de07-46a0-ad9c-9237381f099d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] HTTP exception thrown: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ec72b6b9-de07-46a0-ad9c-9237381f099d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Request method failure captured: Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a HTTP/1.1 Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ_Mg9k-L2RVlFbeDrzZTKh-Rpkrdgjs5wXFw3RL8IjbBzyB1H1GE9m-bwqAzLYHlUBBVR_bizq5cOQPxjvYzlA4ulyNovSWUbczTq-xVO_3xhsRX-kwEtw0YkFnU6IHVIqD7ctMuC14fezNqmeoFr_4Iq_P1nZde-v4GK-exlCenjY Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:21:53.005149 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:21:53.006954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fe9fc68075be4712a305fb8a15c91f19"}]}] Aug 29 19:21:53.006954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:53.006954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:53.006954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:53.006954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:53.006954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:21:53.006954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:21:53.006954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: a982dbba4a324a4f893e427000ce9b93 Aug 29 19:21:53.006954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:53.006954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:21:53.006954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. Aug 29 19:21:53.006954 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': '02876adc-c31e-4c4d-9523-2dba3515274a'} Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:21:53.007905 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. Aug 29 19:21:53.009926 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:53.011220 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ec72b6b9-de07-46a0-ad9c-9237381f099d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Returning 404 to user: Instance 02876adc-c31e-4c4d-9523-2dba3515274a could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:21:53.011220 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ec72b6b9-de07-46a0-ad9c-9237381f099d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a" status: 404 len: 111 microversion: 2.1 time: 0.030612 Aug 29 19:21:53.011220 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 646/1283] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:52 2022] GET /compute/v2.1/servers/02876adc-c31e-4c4d-9523-2dba3515274a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:21:54.142255 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c3b48b91-8048-4cc3-944c-f678ae8d27fe tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:54.142779 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c3b48b91-8048-4cc3-944c-f678ae8d27fe tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:54.149869 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3b48b91-8048-4cc3-944c-f678ae8d27fe tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:54.150344 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3b48b91-8048-4cc3-944c-f678ae8d27fe tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:54.150775 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3b48b91-8048-4cc3-944c-f678ae8d27fe tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:54.151488 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3b48b91-8048-4cc3-944c-f678ae8d27fe tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:54.151934 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3b48b91-8048-4cc3-944c-f678ae8d27fe tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:54.152353 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3b48b91-8048-4cc3-944c-f678ae8d27fe tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:54.167639 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-c3b48b91-8048-4cc3-944c-f678ae8d27fe tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] HTTP exception thrown: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c3b48b91-8048-4cc3-944c-f678ae8d27fe tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Request method failure captured: Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: DELETE /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be HTTP/1.1 Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ_Mg9k-L2RVlFbeDrzZTKh-Rpkrdgjs5wXFw3RL8IjbBzyB1H1GE9m-bwqAzLYHlUBBVR_bizq5cOQPxjvYzlA4ulyNovSWUbczTq-xVO_3xhsRX-kwEtw0YkFnU6IHVIqD7ctMuC14fezNqmeoFr_4Iq_P1nZde-v4GK-exlCenjY Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:21:54.169139 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:21:54.170860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fe9fc68075be4712a305fb8a15c91f19"}]}] Aug 29 19:21:54.170860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:54.170860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:54.170860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:54.170860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:54.170860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:21:54.170860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:21:54.170860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: a982dbba4a324a4f893e427000ce9b93 Aug 29 19:21:54.170860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:54.170860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:21:54.170860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. Aug 29 19:21:54.170860 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': 'd7b368a5-aa99-45d7-a00d-c159874ba2be'} Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:21:54.171909 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. Aug 29 19:21:54.173530 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.175302 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c3b48b91-8048-4cc3-944c-f678ae8d27fe tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Returning 404 to user: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:21:54.175302 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c3b48b91-8048-4cc3-944c-f678ae8d27fe tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "DELETE /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 404 len: 111 microversion: 2.1 time: 0.032169 Aug 29 19:21:54.175302 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 638/1284] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:21:54 2022] DELETE /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:21:54.178952 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bb5637dc-6aba-470d-9b46-c3b1fdd1258d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:54.179584 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bb5637dc-6aba-470d-9b46-c3b1fdd1258d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: d7b368a5-aa99-45d7-a00d-c159874ba2be] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:54.185636 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb5637dc-6aba-470d-9b46-c3b1fdd1258d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:54.186109 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb5637dc-6aba-470d-9b46-c3b1fdd1258d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:54.186539 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb5637dc-6aba-470d-9b46-c3b1fdd1258d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:54.187240 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb5637dc-6aba-470d-9b46-c3b1fdd1258d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:54.187689 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb5637dc-6aba-470d-9b46-c3b1fdd1258d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:54.188113 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb5637dc-6aba-470d-9b46-c3b1fdd1258d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:54.203806 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-bb5637dc-6aba-470d-9b46-c3b1fdd1258d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] HTTP exception thrown: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bb5637dc-6aba-470d-9b46-c3b1fdd1258d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Request method failure captured: Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be HTTP/1.1 Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ_Mg9k-L2RVlFbeDrzZTKh-Rpkrdgjs5wXFw3RL8IjbBzyB1H1GE9m-bwqAzLYHlUBBVR_bizq5cOQPxjvYzlA4ulyNovSWUbczTq-xVO_3xhsRX-kwEtw0YkFnU6IHVIqD7ctMuC14fezNqmeoFr_4Iq_P1nZde-v4GK-exlCenjY Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:21:54.205308 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:21:54.207053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fe9fc68075be4712a305fb8a15c91f19"}]}] Aug 29 19:21:54.207053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:54.207053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:54.207053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:54.207053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:54.207053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:21:54.207053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:21:54.207053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: a982dbba4a324a4f893e427000ce9b93 Aug 29 19:21:54.207053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:54.207053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:21:54.207053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. Aug 29 19:21:54.207053 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': 'd7b368a5-aa99-45d7-a00d-c159874ba2be'} Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:21:54.208310 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. Aug 29 19:21:54.209900 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.211983 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bb5637dc-6aba-470d-9b46-c3b1fdd1258d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Returning 404 to user: Instance d7b368a5-aa99-45d7-a00d-c159874ba2be could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:21:54.211983 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bb5637dc-6aba-470d-9b46-c3b1fdd1258d tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be" status: 404 len: 111 microversion: 2.1 time: 0.031649 Aug 29 19:21:54.211983 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 647/1285] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:54 2022] GET /compute/v2.1/servers/d7b368a5-aa99-45d7-a00d-c159874ba2be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:21:54.215983 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f7c3c002-d288-4a90-b672-fb7aba0166ba tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:54.216477 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f7c3c002-d288-4a90-b672-fb7aba0166ba tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:54.222383 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f7c3c002-d288-4a90-b672-fb7aba0166ba tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:54.222863 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f7c3c002-d288-4a90-b672-fb7aba0166ba tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:54.223325 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f7c3c002-d288-4a90-b672-fb7aba0166ba tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:54.224006 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f7c3c002-d288-4a90-b672-fb7aba0166ba tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:54.224455 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f7c3c002-d288-4a90-b672-fb7aba0166ba tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:54.224883 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f7c3c002-d288-4a90-b672-fb7aba0166ba tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:54.238010 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-f7c3c002-d288-4a90-b672-fb7aba0166ba tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] HTTP exception thrown: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f7c3c002-d288-4a90-b672-fb7aba0166ba tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Request method failure captured: Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: DELETE /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 HTTP/1.1 Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ_Mg9k-L2RVlFbeDrzZTKh-Rpkrdgjs5wXFw3RL8IjbBzyB1H1GE9m-bwqAzLYHlUBBVR_bizq5cOQPxjvYzlA4ulyNovSWUbczTq-xVO_3xhsRX-kwEtw0YkFnU6IHVIqD7ctMuC14fezNqmeoFr_4Iq_P1nZde-v4GK-exlCenjY Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:21:54.239551 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:21:54.241292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fe9fc68075be4712a305fb8a15c91f19"}]}] Aug 29 19:21:54.241292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:54.241292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:54.241292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:54.241292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:54.241292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:21:54.241292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:21:54.241292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: a982dbba4a324a4f893e427000ce9b93 Aug 29 19:21:54.241292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:54.241292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:21:54.241292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. Aug 29 19:21:54.241292 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': 'a07a4d70-1d0f-41b3-8efe-69013ee7ec85'} Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:21:54.242268 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. Aug 29 19:21:54.244071 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.245673 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f7c3c002-d288-4a90-b672-fb7aba0166ba tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Returning 404 to user: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:21:54.245673 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f7c3c002-d288-4a90-b672-fb7aba0166ba tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "DELETE /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 404 len: 111 microversion: 2.1 time: 0.029359 Aug 29 19:21:54.245673 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 639/1286] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:21:54 2022] DELETE /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:21:54.249170 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a3117f8e-15e0-48ef-b197-152e84f4e648 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:54.249785 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a3117f8e-15e0-48ef-b197-152e84f4e648 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: a07a4d70-1d0f-41b3-8efe-69013ee7ec85] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:54.255751 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3117f8e-15e0-48ef-b197-152e84f4e648 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:54.256242 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3117f8e-15e0-48ef-b197-152e84f4e648 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:54.256676 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3117f8e-15e0-48ef-b197-152e84f4e648 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:54.257366 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3117f8e-15e0-48ef-b197-152e84f4e648 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:54.257821 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3117f8e-15e0-48ef-b197-152e84f4e648 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:54.258740 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3117f8e-15e0-48ef-b197-152e84f4e648 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:54.275186 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-a3117f8e-15e0-48ef-b197-152e84f4e648 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] HTTP exception thrown: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a3117f8e-15e0-48ef-b197-152e84f4e648 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Request method failure captured: Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 HTTP/1.1 Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ_Mg9k-L2RVlFbeDrzZTKh-Rpkrdgjs5wXFw3RL8IjbBzyB1H1GE9m-bwqAzLYHlUBBVR_bizq5cOQPxjvYzlA4ulyNovSWUbczTq-xVO_3xhsRX-kwEtw0YkFnU6IHVIqD7ctMuC14fezNqmeoFr_4Iq_P1nZde-v4GK-exlCenjY Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:21:54.276703 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:21:54.278422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fe9fc68075be4712a305fb8a15c91f19"}]}] Aug 29 19:21:54.278422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:54.278422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:54.278422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:54.278422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:54.278422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:21:54.278422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:21:54.278422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: a982dbba4a324a4f893e427000ce9b93 Aug 29 19:21:54.278422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:54.278422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:21:54.278422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. Aug 29 19:21:54.278422 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': 'a07a4d70-1d0f-41b3-8efe-69013ee7ec85'} Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:21:54.279445 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. Aug 29 19:21:54.281018 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:54.282743 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a3117f8e-15e0-48ef-b197-152e84f4e648 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Returning 404 to user: Instance a07a4d70-1d0f-41b3-8efe-69013ee7ec85 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:21:54.282743 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a3117f8e-15e0-48ef-b197-152e84f4e648 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85" status: 404 len: 111 microversion: 2.1 time: 0.032753 Aug 29 19:21:54.282743 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 648/1287] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:54 2022] GET /compute/v2.1/servers/a07a4d70-1d0f-41b3-8efe-69013ee7ec85 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:21:55.415666 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cb9337c5-b3e3-4e81-b961-6d5df9ba0bca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:55.416226 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-cb9337c5-b3e3-4e81-b961-6d5df9ba0bca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:55.422522 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb9337c5-b3e3-4e81-b961-6d5df9ba0bca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:55.423024 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb9337c5-b3e3-4e81-b961-6d5df9ba0bca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:55.423474 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb9337c5-b3e3-4e81-b961-6d5df9ba0bca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:55.424145 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb9337c5-b3e3-4e81-b961-6d5df9ba0bca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:55.424594 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb9337c5-b3e3-4e81-b961-6d5df9ba0bca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:55.425016 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb9337c5-b3e3-4e81-b961-6d5df9ba0bca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:55.438218 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-cb9337c5-b3e3-4e81-b961-6d5df9ba0bca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] HTTP exception thrown: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cb9337c5-b3e3-4e81-b961-6d5df9ba0bca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Request method failure captured: Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: request: DELETE /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d HTTP/1.1 Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Connection: close Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Host: 10.222.0.86 Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.12 Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjDQ_Mg9k-L2RVlFbeDrzZTKh-Rpkrdgjs5wXFw3RL8IjbBzyB1H1GE9m-bwqAzLYHlUBBVR_bizq5cOQPxjvYzlA4ulyNovSWUbczTq-xVO_3xhsRX-kwEtw0YkFnU6IHVIqD7ctMuC14fezNqmeoFr_4Iq_P1nZde-v4GK-exlCenjY Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 29 19:21:55.439801 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 29 19:21:55.441492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fe9fc68075be4712a305fb8a15c91f19"}]}] Aug 29 19:21:55.441492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:55.441492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:55.441492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:55.441492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:55.441492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 29 19:21:55.441492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 29 19:21:55.441492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Id: a982dbba4a324a4f893e427000ce9b93 Aug 29 19:21:55.441492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:55.441492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: method: > Aug 29 19:21:55.441492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: exception: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. Aug 29 19:21:55.441492 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: action_args: {'id': 'df8f7dba-a886-4ceb-815a-9c877abfd96d'} Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:21:55.443291 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. Aug 29 19:21:55.444963 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 29 19:21:55.446595 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cb9337c5-b3e3-4e81-b961-6d5df9ba0bca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Returning 404 to user: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:21:55.446595 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-cb9337c5-b3e3-4e81-b961-6d5df9ba0bca tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "DELETE /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 404 len: 111 microversion: 2.1 time: 0.030015 Aug 29 19:21:55.446595 dv-cinder-850830-2-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 640/1288] 10.222.0.86 () {58 vars in 1239 bytes} [Mon Aug 29 19:21:55 2022] DELETE /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:21:55.449471 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f3316d4c-366b-467f-bcd2-a3e229815198 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:55.450081 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f3316d4c-366b-467f-bcd2-a3e229815198 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] [instance: df8f7dba-a886-4ceb-815a-9c877abfd96d] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:55.456659 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f3316d4c-366b-467f-bcd2-a3e229815198 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:55.457136 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f3316d4c-366b-467f-bcd2-a3e229815198 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:55.457821 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f3316d4c-366b-467f-bcd2-a3e229815198 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:55.458500 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f3316d4c-366b-467f-bcd2-a3e229815198 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Acquiring lock "d74fd249-f6b1-4f68-a608-7346562653bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:55.458945 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f3316d4c-366b-467f-bcd2-a3e229815198 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:55.459390 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f3316d4c-366b-467f-bcd2-a3e229815198 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Lock "d74fd249-f6b1-4f68-a608-7346562653bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:55.473209 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-f3316d4c-366b-467f-bcd2-a3e229815198 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] HTTP exception thrown: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f3316d4c-366b-467f-bcd2-a3e229815198 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Request method failure captured: Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d HTTP/1.1 Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Connection: close Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Host: 10.222.0.86 Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjDQ_Mg9k-L2RVlFbeDrzZTKh-Rpkrdgjs5wXFw3RL8IjbBzyB1H1GE9m-bwqAzLYHlUBBVR_bizq5cOQPxjvYzlA4ulyNovSWUbczTq-xVO_3xhsRX-kwEtw0YkFnU6IHVIqD7ctMuC14fezNqmeoFr_4Iq_P1nZde-v4GK-exlCenjY Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 29 19:21:55.474704 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 29 19:21:55.476456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fe9fc68075be4712a305fb8a15c91f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fe9fc68075be4712a305fb8a15c91f19"}]}] Aug 29 19:21:55.476456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:55.476456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Id: fe9fc68075be4712a305fb8a15c91f19 Aug 29 19:21:55.476456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2056555814 Aug 29 19:21:55.476456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:55.476456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 29 19:21:55.476456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 29 19:21:55.476456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Id: a982dbba4a324a4f893e427000ce9b93 Aug 29 19:21:55.476456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeNegativeTest-2056555814-project Aug 29 19:21:55.476456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: method: > Aug 29 19:21:55.476456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: exception: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. Aug 29 19:21:55.476456 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: action_args: {'id': 'df8f7dba-a886-4ceb-815a-9c877abfd96d'} Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:21:55.478206 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. Aug 29 19:21:55.479858 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 29 19:21:55.481592 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f3316d4c-366b-467f-bcd2-a3e229815198 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] Returning 404 to user: Instance df8f7dba-a886-4ceb-815a-9c877abfd96d could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:21:55.481592 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f3316d4c-366b-467f-bcd2-a3e229815198 tempest-AttachVolumeNegativeTest-2056555814 tempest-AttachVolumeNegativeTest-2056555814-project] 10.222.0.86 "GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d" status: 404 len: 111 microversion: 2.1 time: 0.030434 Aug 29 19:21:55.481592 dv-cinder-850830-2-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 649/1289] 10.222.0.86 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:55 2022] GET /compute/v2.1/servers/df8f7dba-a886-4ceb-815a-9c877abfd96d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)